Querying Hive from Apache Drill causes Stackoverflow error

Question

I am trying to see a table named customers, in hive from drill. I am using Drill in Embedded mode. I am using the default derby database for hive metastore.

When I do a describe, it shows all the columns and types.

But, when I do a select command like this,

select * from customers limit 10;

In the Web UI, this is what I got

org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: StackOverflowError

Hive plugin:

 {
  "type": "hive",
  "enabled": true,
  "configProps": {
    "hive.metastore.uris": "thrift://ip_address:9083",
    "javax.jdo.option.ConnectionURL": "jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
    "hive.metastore.warehouse.dir": "/user/hive/warehouse",
    "fs.default.name": "file///",
    "hive.metastore.sasl.enabled": "false"
  }
}

Errors showed in the Log file:

org.apache.drill.exec.work.foreman.ForemanException: Unexpected exception during fragment initialization: java.lang.AssertionError: Internal error: Error while applying rule DrillPushProjIntoScan,

java.lang.StackOverflowError: null at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:355) ~[hadoop-common-2.7.1.jar:na]

And, finally this

Query failed: org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: StackOverflowError

And, the versions i am using are:

Apache Drill : 1.3.0

Hive : 0.13.1-cdh5.3.0

Hadoop : 2.5.0-cdh5.3.0

I am able to query the same table from hive but drill throws this error. — Durga Swaroop
Are you trying from Drill shell or Drill Web UI? Drill embedded or cluster mode? — Dev
I tried from both the UI and the shell. Both of them say, Stackoverflow error — Durga Swaroop
can you please check /user/hive/warehouse directory in hadoop? I hope you filled all the values from hive-site.xml — Dev

Dev Dev · Accepted Answer · 2015-12-07T11:25:54

This is a version conflict I guess.

According to Drill's Documentation:

Drill 1.0 supports Hive 0.13. Drill 1.1 supports Hive 1.0.

So, for 1.1+ you may get issues with hive 0.13. Read more here.

So upgrade hive to 1.0 or downgrade drill to 1.0 to test this.

Querying Hive from Apache Drill causes Stackoverflow error

1 Answers