Updated on 2022-02-22 GMT+08:00

Creating a Job

A job is composed of one or more nodes that are performed collaboratively to complete data operations. Before developing a job, create a new one.

(Optional) Creating a Directory

If a directory exists, you do not need to create one.

  1. Log in to the DLF console.
  2. In the navigation tree of the Data Development console, choose Data Development > Develop Job.
  3. In the directory list, right-click a directory and choose Create Directory from the shortcut menu.
  4. In the displayed dialog box, configure directory parameters. Table 1 describes the directory parameters.

    Table 1 Job directory parameters

    Parameter

    Description

    Directory Name

    Name of the job directory. Must consist of 1 to 32 characters and contain only letters, digits, underscores (_), and hyphens (-).

    Select Directory

    Parent directory of the job directory. The parent directory is the root directory by default.

  5. Click OK.

Creating a Job

The quantity of jobs is less than the maximum quota (10,000).

  1. In the navigation tree of the Data Development console, choose Data Development > Develop Job.
  2. Create a job using either of the following methods:

    Method 1: In the area on the right, click Create Job.

    Method 2: In the directory list, right-click a directory and choose Create Job from the shortcut menu.

  3. In the displayed dialog box, configure job parameters. Table 2 describes the job parameters.

    Table 2 Job parameters

    Parameter

    Description

    Job Name

    Name of the job. Must consist of 1 to 128 characters and contain only letters, digits, hyphens (-), underscores (_), and periods (.).

    Processing Mode

    Type of the job.

    • Batch: Data is processed periodically in batches based on the scheduling plan, which is used in scenarios with low real-time requirements.
    • Real-Time: Data is processed in real time, which is used in scenarios with high real-time performance.

    Creation Method

    Selects a job creation mode.

    • Create Empty Job: Create an empty job.
    • Create Based on Template: Create a job using a template.

    Select Directory

    Directory to which the job belongs. The root directory is selected by default.

    Job Owner

    Owner of the job.

    Job Priority

    Priority of the job. The value can be High, Medium, or Low.

    Log Path

    Selects the OBS path to save job logs. By default, logs are stored in a bucket named dlf-log-{Projectid}.

    NOTE:

    If you want to customize a storage path, select the bucket that you have created on OBS by referring to the instructions in Configuring a Log Storage Path.

  4. Click OK.