Creating a Job

Updated on 2022-02-22 GMT+08:00

View PDF

A job is composed of one or more nodes that are performed collaboratively to complete data operations. Before developing a job, create a new one.

If a directory exists, you do not need to create one.

Log in to the DLF console.
In the navigation tree of the Data Development console, choose Data Development > Develop Job.
In the directory list, right-click a directory and choose Create Directory from the shortcut menu.

In the displayed dialog box, configure directory parameters. Table 1 describes the directory parameters.

**Table 1** Job directory parameters
Parameter	Description
Directory Name	Name of the job directory. Must consist of 1 to 32 characters and contain only letters, digits, underscores (_), and hyphens (-).
Select Directory	Parent directory of the job directory. The parent directory is the root directory by default.

The quantity of jobs is less than the maximum quota (10,000).

In the navigation tree of the Data Development console, choose Data Development > Develop Job.
Create a job using either of the following methods:

Method 1: In the area on the right, click Create Job.

Method 2: In the directory list, right-click a directory and choose Create Job from the shortcut menu.

In the displayed dialog box, configure job parameters. Table 2 describes the job parameters.

**Table 2** Job parameters
Parameter	Description
Job Name	Name of the job. Must consist of 1 to 128 characters and contain only letters, digits, hyphens (-), underscores (_), and periods (.).
Processing Mode	Type of the job. Batch: Data is processed periodically in batches based on the scheduling plan, which is used in scenarios with low real-time requirements. Real-Time: Data is processed in real time, which is used in scenarios with high real-time performance.
Creation Method	Selects a job creation mode. Create Empty Job: Create an empty job. Create Based on Template: Create a job using a template.
Select Directory	Directory to which the job belongs. The root directory is selected by default.
Job Owner	Owner of the job.
Job Priority	Priority of the job. The value can be High, Medium, or Low.
Log Path	Selects the OBS path to save job logs. By default, logs are stored in a bucket named dlf-log-{Projectid}. NOTE: If you want to customize a storage path, select the bucket that you have created on OBS by referring to the instructions in Configuring a Log Storage Path.