Step 2: Buy a Queue
A queue in DLI is equivalent to an exclusive cluster in CS. It is a logical resource required for job running. Before running a job, log in to the DLI console, choose Queue Management and click Purchase Queue to purchase a general-purpose queue.
- To ensure adequate backend resources, you are advised to submit a service ticket to contact DLI technical support before purchasing a queue with more than 64 CUs.
- Select For general purpose for Queue Type. A SQL queue can only run DLI SQL jobs. A general-purpose queue can run Flink SQL jobs, custom Flink jobs, and Spark jobs.
- If a pay-per-use queue is idle, background resources are automatically released. Therefore, if you have services that require cross-network communication, purchase a yearly/monthly queue or pay-per-use dedicated resource queue (set the billing mode to Pay-per-use and select Dedicated Resource Mode under Queue Type.)
- The two VPCs in a VPC peering connection cannot have overlapping CIDR blocks. Therefore, you need to plan different CIDR blocks and configure CIDR on the Purchase Queue page (select Custom for Advanced Configuration.).
- Currently, DLI queues do not support automatic scaling. Before purchasing a queue, evaluate your resource usage. If you need scale-in or scale-out after a queue is created, choose Queue Management > More > Modify Queue Specifications.
- For details about queue management, see Data Lake Insight User Guide.
Last Article: Step 1: Grant Permissions
Next Article: Step 3: Connect the Network
Did this article solve your problem?
Thank you for your score!Your feedback would help us improve the website.