Updated on 2024-11-29 GMT+08:00

Submitting a MapReduce Job

Scenario

This section describes how to submit an Oozie job of the MapReduce type on the Hue web UI.

Procedure

  1. Create a workflow. For details, see Creating a Workflow.
  2. On the workflow editing page, select next to MapReduce job and drag it to the operation area.
  3. In the MapReduce job window that is displayed, set Jar name to a value, for example, /user/admin/examples/apps/map-reduce/lib/oozie-examples-xxx.jar (xxx indicates the JAR file version, which varies depending on the actual environment). Click Add.
  4. Click PROPERTIES+ to add input and output properties.

    For example, set the value of mapred.input.dir to /user/admin/examples/input-data/text and set the value of mapred.output.dir to /user/admin/examples/output-data/map-reduce_workflow.

  5. Click the configuration button in the upper right corner. On the configuration page that is displayed, click Delete + to delete a directory, for example, /user/admin/examples/output-data/map-reduce_workflow.
  6. Click in the upper right corner of the Oozie editor.

    If you need to modify the job name before saving the job (default value: My Workflow), click the name directly for modification, for example, MapReduce-Workflow.

  7. After the configuration is saved, click , and submit the job.

    After the job is submitted, you can view the related contents of the job, such as the detailed information, logs, and processes, on Hue.