You can override any property which is not marked as final in respective configuration.xml file. To do this
Pass commandline argument to
-D property_name=value
.Or by configuring in you mapred job by
Configuration.set("property_name", "value");
質問
We have mapred.job.reuse.jvm.num.tasks setting as -1(i.e to have jvm reuse with no limit) in hadoop's mapred-site.xml . But i want to override this property in one of my mapred job. Is it possible to override this value to 1 only for one job.
解決
You can override any property which is not marked as final in respective configuration.xml file. To do this
Pass commandline argument to -D property_name=value
.
Or by configuring in you mapred job by
Configuration.set("property_name", "value");
他のヒント
You could use public void setNumTasksToExecutePerJvm(int numTasks). It allows us to set the number of tasks that a spawned task JVM should run before it exits