I just built a Hortonworks cluster with Hive and Spark Thrift Server on port 10016 (default) and tested SELECT statement via beeline to STS
https://spark.apache.org/docs/1.6.0/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
beeline> !connect jdbc:hive2://localhost:10016/default
select * from table1;
I could get the results and everything is fine. But my question is how come the queries don't show up in Spark History Server UI at all? How do I know if it's actually Spark doing the computation work vs. pass thru HiveServer2?
UPDATE 1
This is what I have and log is already enabled by default:
