Help Center>
DataArts Studio>
FAQs>
DataArts Factory>
What Should I Pay Attention to When Using DataArts Studio to Schedule Big Data Services?
Updated on 2022-08-03 GMT+08:00
What Should I Pay Attention to When Using DataArts Studio to Schedule Big Data Services?
Lock management is unavailable for DLI and MRS. Therefore, if you perform read and write operations on the tables simultaneously, data conflict will occur and the operations will fail.
If you want to perform read and write operations on the data tables of big data services, use either of the following methods to perform serial operations:
- Create a job with two nodes, one for the read operation and the other for the write operation, and execute the nodes in sequence to avoid conflicts.
- Create a job for the read operation and another job for the write operation, and configure a dependency relationship between the two jobs to avoid conflicts.
Parent topic: DataArts Factory
DataArts Factory FAQs
- How Many Jobs Can Be Created in DataArts Factory? Is There a Limit on the Number of Nodes in a Job?
- Does DataArts Studio Support Custom Python Scripts?
- How Can I Quickly Rectify a Deleted CDM Cluster Associated with a Job?
- Why Is There a Large Difference Between Job Execution Time and Start Time of a Job?
- Will Subsequent Jobs Be Affected If a Job Fails to Be Executed During Scheduling of Dependent Jobs? What Should I Do?
- What Should I Pay Attention to When Using DataArts Studio to Schedule Big Data Services?
- What Are the Differences and Connections Among Environment Variables, Job Parameters, and Script Parameters?
- What Should I Do If Job Logs Cannot Be Opened and Error 404 Is Reported?
- What Should I Do If the Agency List Fails to Be Obtained During Agency Configuration?
- Why Cannot Specified Peripheral Resources Be Selected When a Data Connection Is Created in Data Development?
- Why Cannot I Receive a Job Failure Alarm Notification After SMN Is Configured?
- Why Is There No Job Running Scheduling Log on the Monitor Instance Page After Periodic Scheduling Is Configured for a Job?
- Why does the GUI display only the failure result but not the specific error cause after Hive SQL and Spark SQL scripts fail to be executed?
- What Do I Do If the Token Is Invalid During the Running of a Data Development Node?
- How Do I View Run Logs After a Job Is Tested?
- Why Does a Job Scheduled by Month Start Running Before the Job Scheduled by Day Is Complete?
- What Should I Do If Invalid Authentication Is Reported When I Run a DLI Script?
- Why Cannot I Select the Desired CDM Cluster in Proxy Mode When Creating a Data Connection?
- Why Is There No Job Running Scheduling Record After Daily Scheduling Is Configured for the Job?
- What Do I Do If No Content Is Displayed in Job Logs?
- Why Do I Fail to Establish a Dependency Between Two Jobs?
- What Should I Do If an Error Is Displayed During DataArts Studio Scheduling: The Job Does Not Have a Submitted Version?
- What Do I Do If an Error Is Displayed During DataArts Studio Scheduling: The Script Associated with Node XXX in the Job Is Not Submitted?
- What Should I Do If a Job Fails to Be Executed After Being Submitted for Scheduling and an Error Displayed: Depend Job [XXX] Is Not Running Or Pause?
- How Do I Create a Database And Data Table? Is the database a data connection?
- Why Is No Result Displayed After an HIVE Task Is Executed?
- Why Does the Last Instance Status On the Monitor Instance page Only Display Succeeded or Failed?
- How Do I Create a Notification for All Jobs?
- What Is the Maximum Number of Nodes That Can Be Executed Simultaneously?
- Can I Change the Time Zone of a DataArts Studio Instance?
- How Do I Synchronize the Changed Names of CDM Jobs to DataArts Factory?
- Why Does the Execution of an RDS SQL Statement Fail and an Error Is Reported Indicating That hll Does Not Exist?
- What Should I Do If Error Message "The account has been locked" Is Displayed When I Am Creating a DWS Data Connection?
- Why Is a Job Instance Canceled and Message "The node start execute failed, so the current node status is set to cancel." Displayed?
- What Should I Do If Error Message "Workspace does not exists" Is Displayed When I Call a DataArts Factory API?
- Why Don't the URL Parameters for Calling an API Take Effect in the Test Environment When the API Can Be Called Properly Using Postman?
- What Should I Do If Error Message "Agent need to be updated?" Is Displayed When I Run a Python Script?
- Why Is an Execution Failure Displayed for a Node in the Log When the Node Status Is Successful?
- What Should I Do If an Unknown Exception Occurs When I Call a DataArts Factory API?
- Why Is an Error Message Indicating an Invalid Resource Name Is Displayed When I Call a Resource Creation API?
- Why Does a PatchData Task Fail When All PatchData Job Instances Are Successful?
- Why Is a Table Unavailable When an Error Message Indicating that the Table Already Exists Is Displayed During Table Creation from a DWS Data Connection?
- What Should I Do If Error Message "The throttling threshold has been reached: policy user over ratelimit,limit:60,time:1 minute." Is Displayed When I Schedule an MRS Spark Job?
- What Should I Do If Error Message "UnicodeEncodeError: 'ascii' codec can't encode characters in position 63-64: ordinal not in range(128)" Is Displayed When I Run a Python Script?
- What Should I Do If an Error Message Is Displayed When I View Logs?
- What Should I Do If a Shell/Python Node Fails and Error "session is down" Is Reported?
- What Should I Do If a Parameter Value in a Request Header Contains More Than 512 Characters?
- What Should I Do If a Message Is Displayed Indicating that the ID Does Not Exist During the Execution of a DWS SQL Script?
- How Do I Check Which Jobs Invoke a CDM Job?
- What Should I Do If Error Message "The request parameter invalid" Is Displayed When I Use Python to Call the API for Executing Scripts?
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbotmore
