Posted By

m1b on 04/20/12


Tagged


Versions (?)

job-file for hadoop job submit example


 / Published in: Bash
 

The Hadoop command guide: http://hadoop.apache.org/common/docs/current/commands_manual.html#job

does not specify the "job-file" format for the hadoop job submit, here's an example of such.

  1. mapred.input.dir=data/file1.txt
  2. mapred.output.dir=output
  3. mapred.job.name=wordcount
  4. mapred.mapper.class=edu.uci.ics.hyracks.examples.wordcount.WordCount$Map
  5. mapred.combiner.class=edu.uci.ics.hyracks.examples.wordcount.WordCount$Reduce
  6. mapred.reducer.class=edu.uci.ics.hyracks.examples.wordcount.WordCount$Reduce
  7. mapred.input.format.class=org.apache.hadoop.mapred.TextInputFormat
  8. mapred.output.format.class=org.apache.hadoop.mapred.TextOutputFormat
  9. mapred.mapoutput.key.class=org.apache.hadoop.io.Text
  10. mapred.mapoutput.value.class=org.apache.hadoop.io.IntWritable
  11. mapred.output.key.class=org.apache.hadoop.io.Text
  12. mapred.output.value.class=org.apache.hadoop.io.IntWritable

Report this snippet  

You need to login to post a comment.