Updated on 2024-11-05 GMT+08:00

Buying an Incremental Package for Job Node Scheduling Times/Day

This package is used to increase the quota of job node scheduling times/day.

The quota of job node scheduling times/day varies depending on the DataArts Studio instance version. This quota refers to the total number of scheduling times of data development jobs, quality jobs, comparison jobs, scenarios, and metadata collection jobs per day. The number of scheduling times of data development job per day is measured by node (including the Dummy node), covering PatchData tasks but not test or retry upon failures. You can locate a DataArts Studio instance, click More, and select Quota Usage to view this quota.

The maximum number of concurrent data development job nodes of a DataArts Studio instance is related to the job node scheduling times/day quota of the instance.

  • When the number of job node scheduling times/day quota is less than or equal to 500, the maximum number of concurrent nodes is 10.
  • When the number of job node scheduling times/day quota is greater than 500 and less than or equal to 5,000, the maximum number of concurrent nodes is 50.
  • When the number of job node scheduling times/day quota is greater than 5,000 and less than or equal to 20,000, the maximum number of concurrent nodes is 100.
  • When the number of job node scheduling times/day quota is greater than 20,000 and less than or equal to 40,000, the maximum number of concurrent nodes is 200.
  • When the number of job node scheduling times/day quota is greater than 40,000 and less than or equal to 80,000, the maximum number of concurrent nodes is 300.
  • When the number of job node scheduling times/day quota is greater than 80,000, the maximum number of concurrent nodes is 400.
If the number of job node scheduling times per day is close to or has reached the upper limit, or if you want to increase the maximum number of concurrent nodes, you are advised to purchase a job node scheduling times/day incremental package.

If the total number of used scheduling times, scheduling times in use, and scheduling times to be used for job nodes on the current day exceeds the upper limit of this version, a message is displayed indicating that the number of job node scheduling times/day exceeds the quota when a batch processing job is scheduled or a real-time job is started.

Context

  • For details about the specifications of DataArts Studio instances of different versions, see Version Specifications.
  • You can locate a DataArts Studio instance, click More, and select View Packages to view your incremental packages.
  • You can locate a DataArts Studio instance, click More, and select Quota Usage to view the quota usage of the instance. You can also locate a workspace on the Workspaces page and click Quota Usage in the Operation column to view the quota usage of the workspace.

Setting the Alarm Threshold for Quota Usage

Before buying a quota expansion incremental package, you can set the alarm threshold for quota usage. When the threshold is reached and an alarm is triggered, you need to buy a quota expansion incremental package. Otherwise, your services may be affected.

To set the alarm threshold for quota usage, perform the following steps:

  1. Locate a DataArts Studio instance, click More, and select Alarm threshold.

    Figure 1 Alarm threshold

  2. Set the alarm threshold to a value from 0 to 100. Value 0 indicates that no alarm will be generated. When the quota usage exceeds the configured alarm threshold, the Simple Message Notification (SMN) service triggers an SMS or email alarm.
  3. Go to the SMN console, choose Topic Management > Topics, and locate the DGC_Topic_Manager_Schedule_Alarm_Project name_Instance ID topic.

    • To obtain the project name, perform the following steps:
      1. Register with and log in to the management console.
      2. Hover the cursor on the username in the upper right corner and select My Credentials from the drop-down list.
      3. On the API Credentials page, obtain the account name, account ID, IAM username, and IAM user ID, and obtain the project and its ID from the project list.
    • To obtain the instance ID, perform the following steps:
      1. On the DataArts Studio console, locate a workspace and click any module, such as Management Center.
      2. On the Management Center page, obtain the values of instanceId and workspace in the browser address bar, which are the instance ID and workspace ID, respectively.
        As shown in Figure 2, the instance ID is 6b88…2688, and the workspace ID is 1dd3bc…d93f0.
        Figure 2 Obtaining the instance ID and workspace ID

  4. In the Operation column of the topic, click Add Subscription. Select SMS or Email for Protocol, and enter the mobile number or email address for receiving alarm notifications.

    Figure 3 Adding a subscription

Buying an Incremental Package for Job Node Scheduling Times/Day

  1. Locate an enabled instance and click Buy.
  2. On the displayed page, set the following parameters:
    • Package: Select Job node scheduling times/day.
    • Billing Mode: Only Package is supported.
    • Flavor: Select a flavor that meets your needs.
    • Required Duration: Select the validity period of the package.
    • Auto-renew: You can select it to enable automatic renewal of the subscription by month or year. If you choose the monthly billing mode, your subscription will be automatically renewed each month. If you choose the yearly billing mode, your subscription will be automatically renewed each year.
  3. Click Buy Now, confirm the specifications, and click Next.
  4. After you purchase the package, its quota will be added to the default quota.