Good tools for monitoring my existing hadoop eco-system?

1
votes

I am looking for a very good tools or open-source system to monitor my hadoop eco-system inluding components like hadoop,spark,oozie,yarn,hdfs,hive,hbase,kafka,zookeeper and so on.

I get ambari but I find that current ambari can be just used to deploy and manage my system from scratch, instead of managing my existing hadoop system.

Any suggestions?

1
hadoopsystemambari
Questions asking us to recommend or find a book, tool, software library, tutorial or other off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it. - Biffen
You can Try Ankush(Open Source) from Impetus github.com/impetus-opensource/ankush/wiki - Bhavesh

1 Answers

0
votes

Ambari has very decent monitoring/alerting capabilities and allow to monitor all the Hadoop components. Check Ambari user guide (see one for the most recent version in PDF). Specifically, see Section 2 (Ambari Dashboards) and Section 8 (Monitoring and Alerts).

p.s. There is a promising project in this space (but still currently at the incubating phase), called Apache Eagle. It attempts to go beyond monitoring itself, particularly to help with identifying different sorts of issues with a Hadoop cluster.