hbase command versus hadoop command

Question

The little bit of description of hbase in the O'Reilly Elephant book shows the use of the 'hbase' command line wrapper to run a map-reduce job using hbase.

However, our code has a long classpath, so we want to use the lib directory feature of hadoop enabled by JobConf.setClassByJar and the 'hadoop' command. While we may have messed something up, it seemed to us that this did not work with the hbase command.

Can ordinary hadoop jobs call the hbase API? Just what does the hbase command-line do?

(hadoop 0.20.2, hbase corresponding)

QuinnG QuinnG · Accepted Answer · 2011-04-12T21:55:34

You can use the HBase API in a Hadoop job.

Here are some code snippets for using HBase API in a Job.

Imports

import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.client.HTable;
import org.apache.hadoop.hbase.client.Put;
import org.apache.hadoop.hbase.util.Bytes;

This is inside a @Override function in my code

private HTable hTable = null;
Configuration hConfig = HBaseConfiguration.create();
hConfig.set(Constants.HBASE_CONFIGURATION_ZOOKEEPER_QUORUM, zkQuorum);
hConfig.set(Constants.HBASE_CONFIGURATION_ZOOKEEPER_CLIENTPORT, zkclientPort);
hTable = new HTable(hConfig, hbCube);
...
hTable.put(subPuts);

Obviously not complete snippets, but with the right imports and providing the correct values your job (I only had a mapper) can access the HBase API.

Hope that helps.

hbase command versus hadoop command

2 Answers