exception with Hive long create table statement

0
votes

I have a "very long" create external table" statement that i try to run in Hive (200+ columns) but I end up with this error message.

Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:For direct MetaStore DB connections, we don't support retries at the client level.)

It's suppose to create an external table over an already populated hbase table. If reduce the number of column in my Hive statement it works.

So could it be the max number of column?, a connection timeout? , the lenght of the statement?

Please share your thought.

Regards, Breach

2
hive

2 Answers

1
votes

Not sure if the number of variables is the real problem given the limited information provided, but this post should be able to help you check if the number of variables is the problem.

Creating a hive table with ~40K columns

0
votes

Change the type of column "PARAM_VALUE" in "SERDE_PARAMS" Table in metastore database.

Try this command if you are using mysql server for storing the metastore DB

  • ALTER TABLE SERDE_PARAMS MODIFY PARAM_VALUE TEXT NOT NULL;

Hope it works for you.