Configuring Task Groups
By configuring a task group, you can control the maximum number of concurrent nodes in a task group in a more fine-grained manner.
Constraints
- This function is available only for batch processing jobs.
- Task groups cannot be used across workspaces.
- For a pipeline job, you can configure a task group for each node or for the job. A task group configured for the job is prior to one configured for a node.
Procedure
- Log in to the DataArts Studio console by following the instructions in Accessing the DataArts Studio Instance Console.
- On the DataArts Studio console, locate a workspace and click DataArts Factory.
- In the left navigation pane, choose Configuration > Configure.
- Choose Task Groups.
- Click Create.
- In the displayed dialog box, set required parameters.
Table 1 Parameters for creating a task group Parameter
Description
Task Group Name
Name of the task group. It must be unique.
Maximum number of concurrency
Maximum number of concurrent job nodes in the current task group
The maximum number of concurrent nodes is the current number of concurrent DataArts Studio instances.
The value cannot exceed the maximum number of concurrent nodes of the DataArts Studio instance, which is 1,000.
The maximum number of concurrent nodes varies depending on the DataArts Studio instance specifications.
Description
Description of the task group
- Click OK.
After the task group is created, go to the job development page. On the canvas of a job, click Scheduling Setup and select the created task group. Then the number of concurrent nodes in the current task group can be controlled in a more fine-grained manner based on the selected task group.
Follow-up Operations
Modifying a task group: Locate a task group and click Modify in the Operation column. The modification takes effect immediately.
Deleting a task group: Locate a task group and click Delete in the Operation column. A task group used by a job cannot be deleted.
Viewing references: Locate a task group and click View Reference in the Operation column to view the jobs that are using the task group.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot