How do i set a custom output committer in the new Hadoop API

Question

I have been using the JobConf.setOutputCommitter() method to set my own OutputCommitter for a map reduce job. With hadoop v 0.20 since this class is deprecated, what will be the alternate to set a custom OutputCommitter? I tried setting the property mapred.output.committer.class in Configuration, but that seems like an invalid property. Have not been able to find an alternate to do this.

Answer 1

I guess it depends on what you mean by new API - in 1.1.1 at least this is no longer deprecated - i think i remember reading that the entire mapred package was prematurely deprecated, and this was un-deprecated in a later release.

If by new API, you mean the mapreduce package over mapred, then the OutputFormats themselves have an associated OutputCommitter, which is acquired via the OutputFormat.getOutputCommitter method