更新时间:2024-05-28 GMT+08:00
Mapreduce应用开发建议
全局使用的配置项,在mapred-site.xml中指定
如下给出接口所对应的mapred-site.xml中的配置项:
setMapperClass(Class <extends Mapper> cls) ->“mapreduce.job.map.class” setReducerClass(Class<extends Reducer> cls) ->“mapreduce.job.reduce.class” setCombinerClass(Class<extends Reducer> cls) ->“mapreduce.job.combine.class” setInputFormatClass(Class<extends InputFormat> cls) ->“mapreduce.job.inputformat.class” setJar(String jar) ->“mapreduce.job.jar” setOutputFormat(Class< extends OutputFormat> theClass) ->“mapred.output.format.class” setOutputKeyClass(Class<> theClass) ->“mapreduce.job.output.key.class” setOutputValueClass(Class<> theClass) ->“mapreduce.job.output.value.class” setPartitionerClass(Class<extends Partitioner> theClass) ->“mapred.partitioner.class” setMapOutputCompressorClass(Class<extends CompressionCodec> codecClass) ->“mapreduce.map.output.compress”&“mapreduce.map.output.compress.codec” setJobPriority(JobPriority prio) ->“mapreduce.job.priority” setQueueName(String queueName) ->“mapreduce.job.queuename” setNumMapTasks(int n) ->“mapreduce.job.maps” setNumReduceTasks(int n) ->“mapreduce.job.reduces”
父主题: Mapreduce应用开发规范