Updated on 2024-05-29 GMT+08:00

Submitting an HDFS Job

Scenario

This section describes how to submit an Oozie job of the HDFS type on the Hue web UI.

Procedure

  1. Create a workflow. For details, see Creating a Workflow.
  2. On the workflow editing page, select next to Fs and drag it to the operation area.
  3. In the Fs window that is displayed, click Add.
  4. Click CREATE DIRECTORY+ to add the HDFS directories to be created, for example, /user/admin/examples/output-data/mkdir_workflow and /user/admin/examples/output-data/mkdir_workflow1.

    If you click DELETE PATH+ to add the HDFS path to be deleted, this parameter cannot be empty. Otherwise, the /user/{Submit user name} directory of the HDFS is deleted by default, which may cause other tasks to run abnormally.

  5. Click in the upper right corner of the Oozie editor.

    If you need to modify the job name before saving the job (default value: My Workflow), click the name directly for modification, for example, HDFS-Workflow.

  6. After the configuration is saved, click , and submit the job.

    After the job is submitted, you can view the related contents of the job, such as the detailed information, logs, and processes, on Hue.