ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/WritableByteArrayComparable

4
votes

From the search, I found this question and I had the same problem following the instructions.

CDH4 Hbase using Pig ERROR 2998 java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/Filter

But didn't worked for me. Besides, I'm using Ubuntu and Hadoop-2.2.0, Hbase-0.96.1-hadoop2 and Pig-0.12.0.

Bashrc

export JAVA_HOME=/usr
export HADOOP_INSTALL=/home/ubuntu/hadoop-2.2.0
export PATH=$PATH:$HADOOP_INSTALL/bin
export PATH=$PATH:$HADOOP_INSTALL/sbin
export HADOOP_MAPRED_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_HOME=$HADOOP_INSTALL
export HADOOP_HDFS_HOME=$HADOOP_INSTALL
export YARN_HOME=$HADOOP_INSTALL

export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_COMMON_HOME}/lib/native
export HADOOP_OPTS="-Djava.library.path=${HADOOP_COMMON_HOME}/lib"
export PIG_HOME=/home/ubuntu/pig-0.12.0
export HBASE_HOME=/home/ubuntu/hbase-0.96.1-hadoop2
export PIG_CLASSPATH="'${HADOOP_INSTALL}/bin/hbase classpath':$PIG_HOME/bin"

Log Pig

Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error.     
org/apache/hadoop/hbase/filter/WritableByteArrayComparable

java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/WritableByteArrayComparable

Pig.properties

fs.defaultFS=hdfs://hadoop-master/
mapred.job.tracker=hadoop-master:8021
1
hadoophbaseapache-pignoclassdeffounderror

1 Answers

5
votes

I got it right

export PIG_CLASSPATH=$PIG_HOME/pig-0.12.0-withouthadoop.jar:$HBASE_HOME/hbase-0.94.1.jar:$HBASE_HOME/lib/*:$HADOOP_COMMON_LIB_NATIVE_DIR/lib/*:$PIG_CLASSPATH