How to Add a New Scheduler in Hadoop?

StackOverflow https://stackoverflow.com/questions/17125090

Question

I'm trying to add a new scheduler in Hadoop. Its not the default ones (FairScheduler/CapacityScheduler). I checked out the source with svn. Now, which source file/class should I edit to get this functionality?

Was it helpful?

Solution

You should extend the class TaskScheduler in order to write your own scheduler. Once done, you can plug it in your code via the JobTracker property mapred.jobtracker.taskScheduler. You can find TaskScheduler inside org.apache.hadoop.mapred.

HTH

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top