2
votes

I need to turn it off in hadoop source code ,and I can not find its package in eclipse. https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/mapreduce/Job.html#setReduceSpeculativeExecution%28boolean%29

1
why you need source code for this? you can turn off speculative execution by this configs: mapreduce.map.speculative and mapreduce.reduce.speculativefi11er
I need the name of the package and class.mndn

1 Answers

2
votes

If you want to disable Speculative Execution, add these properties in mapred-site.xml.

<property>
   <name>mapreduce.map.speculative</name>
   <value>false</value>
</property>
<property>
   <name>mapreduce.reduce.speculative</name>
   <value>false</value>
</property>

Or at the Job level, set the properties in the Driver class.

Configuration conf = new Configuration();
conf.set(“mapreduce.map.speculative”,false);
conf.set(“mapreduce.reduce.speculative”,false);

For its source code refer these: hadoop-mapreduce-project, Job and JobConf