更新时间:2024-05-28 GMT+08:00
分享

Mapreduce应用开发建议

全局使用的配置项,在mapred-site.xml中指定

如下给出接口所对应的mapred-site.xml中的配置项:

setMapperClass(Class <extends Mapper> cls) ->“mapreduce.job.map.class”
setReducerClass(Class<extends Reducer> cls) ->“mapreduce.job.reduce.class”
setCombinerClass(Class<extends Reducer> cls) ->“mapreduce.job.combine.class”
setInputFormatClass(Class<extends InputFormat> cls) ->“mapreduce.job.inputformat.class”
setJar(String jar) ->“mapreduce.job.jar”
setOutputFormat(Class< extends OutputFormat> theClass) ->“mapred.output.format.class”
setOutputKeyClass(Class<> theClass) ->“mapreduce.job.output.key.class”
setOutputValueClass(Class<> theClass) ->“mapreduce.job.output.value.class”
setPartitionerClass(Class<extends Partitioner> theClass) ->“mapred.partitioner.class”
setMapOutputCompressorClass(Class<extends CompressionCodec> codecClass)
->“mapreduce.map.output.compress”&“mapreduce.map.output.compress.codec”
setJobPriority(JobPriority prio) ->“mapreduce.job.priority”
setQueueName(String queueName) ->“mapreduce.job.queuename”
setNumMapTasks(int n) ->“mapreduce.job.maps”
setNumReduceTasks(int n) ->“mapreduce.job.reduces”
分享:

    相关文档

    相关产品