Advanced Search

job-file for hadoop job submit example

/ Published in: Bash
Save to your folder(s)
The Hadoop command guide:
http://hadoop.apache.org/common/docs/current/commands_manual.html#job

does not specify the "job-file" format for the hadoop job submit, here's an example of such.

Expand | Embed | Plain Text

Copy this code and paste it in your HTML 
  1. mapred.input.dir=data/file1.txt
  2. mapred.output.dir=output
  3. mapred.job.name=wordcount
  4. mapred.mapper.class=edu.uci.ics.hyracks.examples.wordcount.WordCount$Map
  5. mapred.combiner.class=edu.uci.ics.hyracks.examples.wordcount.WordCount$Reduce
  6. mapred.reducer.class=edu.uci.ics.hyracks.examples.wordcount.WordCount$Reduce
  7. mapred.input.format.class=org.apache.hadoop.mapred.TextInputFormat
  8. mapred.output.format.class=org.apache.hadoop.mapred.TextOutputFormat
  9. mapred.mapoutput.key.class=org.apache.hadoop.io.Text
  10. mapred.mapoutput.value.class=org.apache.hadoop.io.IntWritable
  11. mapred.output.key.class=org.apache.hadoop.io.Text
  12. mapred.output.value.class=org.apache.hadoop.io.IntWritable

Report this snippet


Comments

RSS Icon Subscribe to comments

You need to login to post a comment.