DataArts Studio Best Practices

This manual is a comprehensive collection of best practices in using DataArts Studio. For each task, a detailed description of the solution and operation procedures is provided. Check this manual based on the task at hand.

DataArts Studio Best Practices

**Table 1** DataArts Studio best practices
Category	Reference
Advanced CDM practices	Incremental File Migration
	Incremental Migration of Relational Databases
	HBase/CloudTable Incremental Migration
	MongoDB/DDS Incremental Migration
	Using Macro Variables of Date and Time
	Migration in Transaction Mode
	Encryption and Decryption During File Migration
	MD5 Verification
	Configuring Field Converters
	Adding Fields
	Migrating Files with Specified Names
	Regular Expressions for Separating Semi-structured Text
	Recording the Time When Data Is Written to the Database
	File Formats
	Converting Unsupported Data Types
Advanced data development practices	Comparison Between Traditional Periodic Scheduling Dependency and Natural Periodic Scheduling Dependency
	Traditional Periodic Scheduling
	Natural Periodic Scheduling
	Natural Periodic Scheduling: Same-Period Dependency
	Natural Periodic Scheduling: Dependency on the Previous Period
	Scheduling by Discrete Hours and Scheduling by the Nearest Job Instance
	Using PatchData
	Setting the Job Scheduling Time to the Last Day of Each Month
	Obtaining the Output of an SQL Node
	IF Statements
	Obtaining the Return Value of a Rest Client Node
	Using For Each Nodes
	Invoking DataArts Quality Operators Using DataArts Factory and Transferring Quality Parameters During Job Running
	Scheduling Jobs Across Workspaces
	Using a Python Script to Connect to an MRS Security Cluster and Execute Impala SQL Statements
	Configuring a Daily Job That Depends on a Minute-Level Job
Data migration practices	Data Migration Overview
	Management Center Data Migration Configuration
	DataArts Migration Data Migration Configuration
	DataArts Architecture Data Migration Configuration
	DataArts Factory Data Migration Configuration
	DataArts Quality Data Migration Configuration
	DataArts Catalog Data Migration Configuration
	DataArts Security Data Migration Configuration
	DataArts DataService Data Migration Configuration
Authorization practices	Minimizing User Permissions
Authorization practices	Minimizing Agency Permissions
Security practices	DataArts Studio Security Best Practices
Inter-component practices	How Do I View the Number of Table Rows and Database Size?
	Comparing Data Before and After Data Migration Using DataArts Quality
	Scheduling a CDM Job by Transferring Parameters Using DataArts Factory
	Enabling Incremental Data Migration Through DataArts Factory
	Creating Table Migration Jobs in Batches Using CDM Nodes
Inter-service practices	Automatic Construction and Analysis of Graph Data
	Simplified Migration of Trade Data to the Cloud and Analysis
	Migration of IoV Big Data to the Lake Without Loss
	Real-Time Alarm Platform Construction
Alarm configuration practices	Configuring Alarms for Jobs in DataArts Factory