Working with HBase EMR from another EC2 server using python on Amazon AWS

1
votes

I created a server EC2 on Amazon AWS and I installed the HappyBase python library for working with HBASE. Also I created a Job Cluster Hbase in EMR. Then I tried to run the script on the first server on EC2:

import happybase
connection = happybase.Connection('….us-west-2.compute.amazonaws.com')
connection.open ()
print connection.tables ()

But I get an error that the server is not found. As host I have Hbase cluster public dns. What I need to configure for working with the database created in the EMR from another EC2 server using python happybase? Thanks.

1
pythonamazonhbase

1 Answers

2
votes

Did you start Thrift server on your cluster master node? You can do it with 

$ ssh -i <your-key.pem> hadoop@<master-node-dns>
$ hbase-daemon.sh start thrift

For this to work, HBase must be configured on your cluster. You have to choose HBase job type if configuring a job from visual interface.

In old management console ensure that step Start HBase is present under Steps tab, and bootstrap action Install HBase is under Bootstrap Actions.

In new console, in a Cluster Details window, there is Applications section, check that a row like

Applications:HBase 0.92.0

is present there.

When all done corectly, ssh on your master instance, and check for hbase-daemon script with 

~$ which hbase-daemon.sh
/home/hadoop/bin/hbase-daemon.sh