Updated on 2024-07-19 GMT+08:00

Submitting a MapReduce Job

Scenario

This section describes how to submit an Oozie job of the MapReduce type on the Hue web UI.

Procedure

  1. Create a workflow. For details, see Creating a Workflow.
  2. On the workflow editing page, select next to MapReduce job and drag it to the operation area.
  3. In the displayed MapReduce job dialog box, set Jar name, for example, to /user/admin/examples/apps/map-reduce/lib/oozie-examples-5.1.0.jar. Click Add.
  4. Click PROPERTIES+ to add input and output properties.

    For example, set the value of mapred.input.dir to /user/admin/examples/input-data/text and set the value of mapred.output.dir to /user/admin/examples/output-data/map-reduce_workflow.

  5. Click the configuration button in the upper right corner. On the configuration page that is displayed, click Delete + to delete a directory, for example, /user/admin/examples/output-data/map-reduce_workflow.
  6. Click in the upper right corner of the Oozie editor.

    If you need to modify the job name before saving the job (default value: My Workflow), click the name directly for modification, for example, MapReduce-Workflow.

  7. After the configuration is saved, click , and submit the job.

    After the job is submitted, you can view the related contents of the job, such as the detailed information, logs, and processes, on Hue.