Help Center/ Data Lake Insight/ FAQs/ DLI Elastic Resource Pools and Queues/ How Do I Migrate an Old Version Spark Queue to a General-Purpose Queue?
Updated on 2024-11-15 GMT+08:00

How Do I Migrate an Old Version Spark Queue to a General-Purpose Queue?

Currently, DLI provides two types of queues, For SQL and For general use. SQL queues are used to run SQL jobs. General-use queues are compatible with Spark queues of earlier versions and are used to run Spark and Flink jobs.

You can perform the following steps to convert an old Spark queue to a general purpose queue.

  1. Purchase a general purpose queue again.
  2. Migrate the jobs in the old Spark queue to the new general queue. That is, specify a new queue when submitting Spark jobs.
  3. Release the old Spark queue, that is, delete it or unsubscribe it from the queue.