Updated on 2024-11-29 GMT+08:00

Submitting an HDFS Job

Scenario

This section describes how to submit an Oozie job of the HDFS type on the Hue web UI.

Procedure

  1. Create a workflow. For details, see Creating a Workflow.
  2. On the workflow editing page, select next to Fs and drag it to the operation area.
  3. In the Fs window that is displayed, click Add.
  4. Click CREATE DIRECTORY+ to add the HDFS directories to be created, for example, /user/admin/examples/output-data/mkdir_workflow and /user/admin/examples/output-data/mkdir_workflow1.

    If you click DELETE PATH+ to delete HDFS directories, this parameter cannot be left empty. Otherwise, the /user/{User who submit the job} directory of the HDFS will be deleted by default, which may cause running errors of other tasks.

  5. Click in the upper right corner of the Oozie editor.

    If you need to modify the job name before saving the job (default value: My Workflow), click the name directly for modification, for example, HDFS-Workflow.

  6. After the configuration is saved, click , and submit the job.

    After the job is submitted, you can view the related contents of the job, such as the detailed information, logs, and processes, on Hue.