Flink Job Management
On the Job Management page of Flink jobs, you can submit a Flink job. Currently, the following job types are supported:
- Flink SQL: uses SQL statements to define jobs and can be submitted to any queue.
- Flink Jar: customizes a JAR package job based on Flink APIs. It can run on dedicated queues.
- Flink Edge SQL: analyzes edge device data using SQL and can be deployed on edge nodes.
Flink job management provides the following functions:
- Managing Flink Job Permissions
- Creating a Flink SQL Job
- Creating a User-Defined Flink Job
- Debugging a Job
- Editing a job
- Starting a Job
- Stopping a Job
- Deleting a Job
- Exporting a Job
- Importing a Job
- Modifying Name and Description
- Importing to a Savepoint
- Triggering a Savepoint
- Job Details
In addition, you can click Quick Links to switch to the details on User Guide.
Assigning Agency Permissions
Agencies are required for DLI to execute Flink jobs. You can set the agency when logging in to the management console for the first time or go to Global Configurations > Service Authorization to modify the agencies.
The permissions are as follows:
- Tenant Administrator (global): Tenant Administrator permissions are required to access data from OBS to execute Flink jobs on DLI, for example, obtaining OBS/DWS data sources, log dump (including bucket authorization), checkpointing enabling, and job import and export.
Due to cloud service cache differences, operations require about 60 minutes to take effect.
- DIS Administrator permissions are required to use DIS data as the data source of DLI Flink jobs.
Due to cloud service cache differences, operations require about 30 minutes to take effect.
- To use CloudTable data as the data source of DLI Flink jobs, CloudTable Administrator permissions are required.
Due to cloud service cache differences, operations require about 3 minutes to take effect.
- To use IEF to execute Flink Edge jobs in DLI, Tenant Administrator permissions are required. This permission is also required for running other services that require the Tenant Administrator permission.
Due to cloud service cache differences, operations require about 3 minutes to take effect.
Job Management page
On the Overview page, click Flink Jobs to go to the SQL job management page. Alternatively, you can click Job Management > Flink Jobs. The Flink Jobs page displays all Flink jobs. If there are a large number of jobs, they will be displayed on multiple pages. DLI allows you to view jobs in all statuses.
Parameter |
Description |
---|---|
ID |
ID of a submitted Flink job, which is generated by the system by default. |
Name |
Name of the submitted Flink job. |
Type |
Type of the submitted Flink job. Including:
|
Status |
Job statuses, including:
|
Description |
Description of the submitted Flink job. |
Username |
Name of the user who submits a job. |
Created |
Time when a job is created. Jobs can be displayed in ascending or descending order of the job creation time. |
Started |
Time when a Flink job starts to run. |
Duration |
Time consumed by job running. |
Operation |
|
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot