Configuring a Bucket for Saving Job Results

Scenario

DLI allows you to save the results of SQL jobs to a DLI job bucket for persistent storage and management.

Notes and Constraints

• Once enabled, the job result saving policy cannot be disabled. Job results will always be saved to the DLI job bucket specified by the user.

Step 1: Configure the DLI Job Bucket

For more constraints on configuring the DLI job bucket, see Configuring a DLI Job Bucket.

1. Log in to the DLI management console.
2. In the navigation pane, choose Global Configuration > Project.
3. On the Project page, click next to Job Bucket to configure bucket information.
   Figure 1 Project
   
4. Click to view available buckets.
5. Select the bucket for storing the temporary data of the DLI job and click OK.
   Temporary data generated during DLI job running will be stored in the OBS bucket.

   Figure 2 Setting the job bucket
   

Step 2: Enable Job Result Saving to a DLI Job Bucket

1. Log in to the DLI management console.
2. In the navigation pane, choose Resources > Queue Management.
3. Locate the queue for which you want to set properties, click More in the Operation column, and select Set Property.
4. Go to the queue property setting page and set property parameters. Table 2 describes the property parameters.

   Table 1 Queue properties

   Property Type	Property	API Parameter	Description
   Job result saving policy	Set Result Saving Policy	job.saveJobResultToJobBucket	Whether to save job results to a DLI job bucket. This parameter is only available for Spark SQL queues.

5. Click OK.

How Do I Check if Job Result Saving to a DLI Job Bucket Is Enabled for a SQL Queue?

• Method 1: View the result path on the SQL job details page.
  1. Log in to the DLI management console.
  2. In the navigation pane, choose Job Management > SQL Jobs.
  3. Locate a desired SQL job and click next to the queue name to expand the job details.
  4. Check the result path in the job details.
     • If the result path displays a custom DLI job bucket, the feature of saving job results to a DLI job bucket is enabled for the queue running the job.
     • If the result path is not displayed in the job details, the feature is not enabled for the queue running the job.
• Method 2: Check whether job result saving to a job bucket is enabled in the SQL queue properties.
  1. Log in to the DLI management console.
  2. In the navigation pane, choose Resources > Queue Management.
  3. Locate the queue for which you want to set properties, click More in the Operation column, and select Set Property.
  4. On the Set Property dialog box that appears, check whether the feature is enabled.

Job Result Return Limits When Using JDBC to Submit SQL Jobs to DLI