Help Center>
DataArts Studio>
FAQs>
DataArts Factory>
What Are the Differences and Connections Among Environment Variables, Job Parameters, and Script Parameters?
Updated on 2023-09-27 GMT+08:00
What Are the Differences and Connections Among Environment Variables, Job Parameters, and Script Parameters?
Parameters can be set in environment variables, job parameters, and script parameters, but their application scopes are different. If there is a conflict when parameters in environment variables, job parameters, and script parameters of the same name, the calling priority is: job parameters > environment variables > script parameters.
Introduction and usage of environment variables, job parameters, and script parameters are as follows:
- Variables and constants can be defined in environment variables. Environment variables take effect in current workspace.
- The value of a variable (such as workspace name) varies depending on the workspace. When exporting a variable from a workspace and import it to another workspace, you must reconfigure its value.
- The value of a constant in different workspaces is the same. When importing a constant to another workspace, you do not need to reconfigure its value.
Figure 1 Environment variable
- Parameters and constants can be defined in job parameters. Job parameters take effect in current job.
- The value of a parameter varies depending on jobs. When exporting a parameter from a workspace and import it to another workspace, you must reconfigure its value.
- The value of a constant in different jobs is the same. When importing a constant to another job, you do not need to reconfigure its value.
Figure 2 Job parameter.
- Script parameters take effect in current script and it can be used in the following ways.
- Enter SQL script parameters in the script editor (Flink SQL is not supported). If the script is executed independently, you can configure the parameters in the lower part of the editor, as shown in Figure 3. If the script is executed by job scheduling, you can assign values to the parameters based on node attributes, as shown in Figure 4.
- For Shell scripts, you can enter a parameter and an interactive parameter to transfer the parameters.
- For Python scripts, you can enter a parameter and an interactive parameter to transfer the parameters.
Parent topic: DataArts Factory
DataArts Factory FAQs
- How Many Jobs Can Be Created in DataArts Factory? Is There a Limit on the Number of Nodes in a Job?
- Does DataArts Studio Support Custom Python Scripts?
- How Can I Quickly Rectify a Deleted CDM Cluster Associated with a Job?
- Why Is There a Large Difference Between Job Execution Time and Start Time of a Job?
- Will Subsequent Jobs Be Affected If a Job Fails to Be Executed During Scheduling of Dependent Jobs? What Should I Do?
- What Should I Pay Attention to When Using DataArts Studio to Schedule Big Data Services?
- What Are the Differences and Connections Among Environment Variables, Job Parameters, and Script Parameters?
- What Should I Do If Job Logs Cannot Be Opened and Error 404 Is Reported?
- What Should I Do If the Agency List Fails to Be Obtained During Agency Configuration?
- Why Cannot Specified Peripheral Resources Be Selected When a Data Connection Is Created in Data Development?
- Why Cannot I Receive a Job Failure Alarm Notification After SMN Is Configured?
- Why Is There No Job Running Scheduling Log on the Monitor Instance Page After Periodic Scheduling Is Configured for a Job?
- Why does the GUI display only the failure result but not the specific error cause after Hive SQL and Spark SQL scripts fail to be executed?
- What Do I Do If the Token Is Invalid During the Running of a Data Development Node?
- How Do I View Run Logs After a Job Is Tested?
- Why Does a Job Scheduled by Month Start Running Before the Job Scheduled by Day Is Complete?
- What Should I Do If Invalid Authentication Is Reported When I Run a DLI Script?
- Why Cannot I Select the Desired CDM Cluster in Proxy Mode When Creating a Data Connection?
- Why Is There No Job Running Scheduling Record After Daily Scheduling Is Configured for the Job?
- What Do I Do If No Content Is Displayed in Job Logs?
- Why Do I Fail to Establish a Dependency Between Two Jobs?
- What Should I Do If an Error Is Displayed During DataArts Studio Scheduling: The Job Does Not Have a Submitted Version?
- What Do I Do If an Error Is Displayed During DataArts Studio Scheduling: The Script Associated with Node XXX in the Job Is Not Submitted?
- What Should I Do If a Job Fails to Be Executed After Being Submitted for Scheduling and an Error Displayed: Depend Job [XXX] Is Not Running Or Pause?
- How Do I Create a Database And Data Table? Is the database a data connection?
- Why Is No Result Displayed After an HIVE Task Is Executed?
- Why Does the Last Instance Status On the Monitor Instance page Only Display Succeeded or Failed?
- How Do I Create a Notification for All Jobs?
- What Is the Maximum Number of Nodes That Can Be Executed Simultaneously?
- Can I Change the Time Zone of a DataArts Studio Instance?
- How Do I Synchronize the Changed Names of CDM Jobs to DataArts Factory?
- Why Does the Execution of an RDS SQL Statement Fail and an Error Is Reported Indicating That hll Does Not Exist?
- What Should I Do If Error Message "The account has been locked" Is Displayed When I Am Creating a DWS Data Connection?
- Why Is a Job Instance Canceled and Message "The node start execute failed, so the current node status is set to cancel." Displayed?
- What Should I Do If Error Message "Workspace does not exists" Is Displayed When I Call a DataArts Factory API?
- Why Don't the URL Parameters for Calling an API Take Effect in the Test Environment When the API Can Be Called Properly Using Postman?
- What Should I Do If Error Message "Agent need to be updated?" Is Displayed When I Run a Python Script?
- Why Is an Execution Failure Displayed for a Node in the Log When the Node Status Is Successful?
- What Should I Do If an Unknown Exception Occurs When I Call a DataArts Factory API?
- Why Is an Error Message Indicating an Invalid Resource Name Is Displayed When I Call a Resource Creation API?
- Why Does a PatchData Task Fail When All PatchData Job Instances Are Successful?
- Why Is a Table Unavailable When an Error Message Indicating that the Table Already Exists Is Displayed During Table Creation from a DWS Data Connection?
- What Should I Do If Error Message "The throttling threshold has been reached: policy user over ratelimit,limit:60,time:1 minute." Is Displayed When I Schedule an MRS Spark Job?
- What Should I Do If Error Message "UnicodeEncodeError: 'ascii' codec can't encode characters in position 63-64: ordinal not in range(128)" Is Displayed When I Run a Python Script?
- What Should I Do If an Error Message Is Displayed When I View Logs?
- What Should I Do If a Shell/Python Node Fails and Error "session is down" Is Reported?
- What Should I Do If a Parameter Value in a Request Header Contains More Than 512 Characters?
- What Should I Do If a Message Is Displayed Indicating that the ID Does Not Exist During the Execution of a DWS SQL Script?
- How Do I Check Which Jobs Invoke a CDM Job?
- What Should I Do If Error Message "The request parameter invalid" Is Displayed When I Use Python to Call the API for Executing Scripts?
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbotmore
