Updated on 2024-07-19 GMT+08:00

Submitting a Shell Job

Scenario

This section describes how to submit an Oozie job of the Shell type on the Hue web UI.

Procedure

  1. Create a workflow. For details, see Creating a Workflow.
  2. On the workflow editing page, select next to Shell and drag it to the operation area.
  3. In the Shell window that is displayed, set Shell command, for example, to oozie_shell.sh, and click Add.
  4. Click FILE+ to add the Shell command execution file or Oozie example execution file. You can select a file stored in HDFS or a local file.

    • If the file is stored in HDFS, select the path of the .sh file, for example, user/hueuser/shell/oozie_shell.sh.

    • If you select a local file, click Upload a file on the Choose a file page to upload the local file. After the file is uploaded, select the file.

  5. If the shell file to be executed needs to transfer parameters, click ARGUMENTS+ to set parameters.

    The sequence of transferring parameters must be the same as that in the shell script.

  6. Click in the upper right corner of the Oozie editor.

    If you need to modify the job name before saving the job (default value: My Workflow), click the name directly for modification, for example, Shell-Workflow.

  7. After the configuration is saved, click , and submit the job.

    After the job is submitted, you can view the related contents of the job, such as the detailed information, logs, and processes, on Hue.

    • When configuring a shell command as a Linux command, specify it as the original command instead of the shortcut key command. For example, do not set ls -l to ll. You can configure it as the shell command ls, and add a parameter -l.
    • When uploading the shell script to HDFS on Windows, make sure that the shell script format is Unix. If the format is incorrect, the shell job fails to be submitted.