Difference between Hadoop Map Reduce and Google Map Reduce

18
votes

What is the difference between Hadoop Map Reduce and Google Map Reduce?

Is it just Hadoop provides standardization for map reduce and others? what else is amongst the diff.

4
hadoopmapreduce
I am not sure if this question is valid for this place. – KKa

4 Answers

22
votes

Google MapReduce and Hadoop are two different implementations (instances) of the MapReduce framework/concept. Hadoop is open source , Google MapReduce is not and actually there are not so many available details about it.

Since they work with large data sets, they have to rely on distributed file systems. Hadoop uses as a standard distributed file system the HDFS (Hadoop Distributed File Systems) while Google MapReduce uses GFS (Google File System)

Hadooop is implemented in java. Google MapReduce seems to be in C++.

2
votes

Google has exposed Map Reduce functionality via their BigQuery webservice. It works like Hadoop with Hive (i.e. using a SQL-like language which generates Map Reduce jobs in the background.) An example, using the browser-based query tool for Big Query is shown below. As is typical with Google's release of their technologies as public offerings, internal details are not exposed, nor can you tune or adjust settings. You simply use the API to call the web service and use Google's infrastructure to return the results to your application.

enter image description here