2020-07-07

This is the twenty-eighth official release.

Modified Permissions Policies and Supported Actions.

2020-1-21

This is the twenty-seventh official release.

Modified response parameters in sections Creating a Link and Modifying a Link.

2019-12-24

This is the twenty-sixth official release.

Modified the status code description in section Status Code.

2019-11-05

This is the twenty-fifth official release.

Modified the parameter description for restarting a cluster in section Restarting a Cluster.

2019-10-08

This is the twenty-fourth official release.

Added the traffic limit and precautions for using CDM APIs in section API Overview.

2019-09-22

This is the twenty-third official release.

Deleted the description about the region and AZ from section Concepts.

2019-09-11

This is the twenty-second official release.

Added the function of calling the API to obtain a project ID in Obtaining the Project ID, Account Name, and AK/SK.

2019-08-02

This is the twenty-first official release.

Modified the URI of the API used to query the cluster list in section Querying the Cluster List.

2019-07-23

This is the twentieth official release.

Modified the JSON format. For details, see Querying a Job and Link to DIS.

2019-07-02

This is the nineteenth official release.

• Supported the export from Tencent Cloud Object Storage (COS) to OBS and updated sections Creating a Link and Link to KODO/COS.
• Supported the migration of historical files based on the creation time and updated sections From Object Storage, From HDFS, and From FTP/SFTP/NAS/SFS.

2019-06-06

This is the eighteenth official release.

• Optimized the document outline.
• Modified From a Relational Database because concurrent migration of Oracle partition tables is supported.
• Modified From a Relational Database: When exporting data from a MySQL database, you can migrate all tables starting with a prefix (the number and types of fields in the tables must be the same) to a Hive table.
• Modified To OBS: When data is imported to OBS, CDM allows you to use KMS keys of other projects to encrypt data.
• CDM can connect to the MRS 2.0 cluster.

2019-04-03

This is the seventeenth official release.

• Added Permissions Policies and Supported Actions because the IAM fine-grained authorization policy is supported.
• Modified Job Parameter Description because the job group is supported.
• Modified the following sections because the AES-256-GCM (NoPadding) algorithm can be used to encrypt and decrypt files in file migrations:
  • From Object Storage
  • From HDFS
  • From FTP/SFTP/NAS/SFS
  • From HTTP/HTTPS
  • To OBS
  • To HDFS
  • To FTP/SFTP/NAS/SFS

2019-01-30

This is the sixteenth official release.

• Modified From DIS and From Kafka because the binary format is supported in data migration of Kafka, DIS, and DMS.
• Modified From HTTP/HTTPS because you can choose whether to delete the query parameter from the name of the objects uploaded to OBS.

2019-01-07

This is the fifteenth official release.

• Added Creating and Executing a Job in a Random Cluster.
• Modified the parameters in From HDFS because when CDM extracts files from HDFS, a snapshot can be created for the HDFS source directory.
• Modified the parameters in To Elasticsearch/Cloud Search Service because for streaming jobs that continuously write data to Elasticsearch, CDM periodically creates indexes and writes data to the indexes, which helps you delete expired data.

2018-11-30

This is the fourteenth official release.

• Added the following sections because CDM supports data migration of DMS Kafka and Amazon S3:
  • Link to Amazon S3
  • Link to DMS Kafka
• Modified the following sections because the file separator can be customized and the heading line of the table can be written to the target file:
  • From Object Storage
  • From FTP/SFTP/NAS/SFS
  • To OBS
  • To FTP/SFTP/NAS/SFS
• Modified To a Relational Database because during relational database migration, data in the destination table can be deleted based on the WHERE clause.

2018-10-30

This is the thirteenth official release.

• Modified To OBS because after data is successfully imported to OBS, a job success marker file is written.
• Added To DIS.

2018-09-30

This is the twelfth official release.

• Modified the following sections because CDM supports data migration of SFS:
  • Link to NAS/SFS
  • From FTP/SFTP/NAS/SFS
  • To FTP/SFTP/NAS/SFS
• Changed domain name of OBS to bucket-level domain name in Link to OBS.
• Added custom SQL statement used for data export to From a Relational Database.
• Added the following sections:
  • Link to CloudTable OpenTSDB
  • From OpenTSDB
  • To OpenTSDB

2018-08-31

This is the eleventh official release.

• Added To DIS.
• Modified the following sections because the time filter function is added:
  • From Object Storage
  • From HDFS
  • From FTP/SFTP/NAS/SFS

2018-08-03

This is the tenth official release.

• Added the cdm.xlarge flavor to Creating a Cluster.
• Updated the Start Job by Marker File and Use Quote Character functions for file migration jobs in the following sections:
  • From Object Storage
  • From FTP/SFTP/NAS/SFS
  • To OBS
  • To FTP/SFTP/NAS/SFS
• Added the data type match function of HBase to To HBase/CloudTable.

2018-07-05

This is the ninth official release.

• Added Link to KODO/COS.
• Added the linkConfig.runMode parameter to the HDFS and HBase links. The following sections are updated:
  • Link to HDFS
  • Link to HBase
• Modified From Elasticsearch/Cloud Search Service because when Elasticsearch or Cloud Search Service is the migration source, data can be filtered using filter criteria.
• Updated To OBS. When exported to OBS, the data is fragmented by size.

2018-06-02

This is the eighth official release.

• Added From HTTP/HTTPS.
• Added the retry function after configuration failure to Job Parameter Description.
• Added the pipeline and authentication configurations of the Elasticsearch data source to the following sections:
  • Link to Elasticsearch/Cloud Search Service
  • To Elasticsearch/Cloud Search Service

2018-05-04

This is the seventh official release.

• Added the following sections:
  • Stopping a Cluster
  • Starting a Cluster
  • Link to CloudTable
  • To DDS
• Modified the following sections:
  • Creating a Link
  • Link to a Relational Database
  • Link to OBS
  • Link to OSS on Alibaba Cloud
  • Link to HDFS
  • Link to HBase
• Changed Elasticsearch Service of HUAWEI CLOUD to Cloud Search Service.
• Changed Unlimited Query Service (UQuery) of HUAWEI CLOUD to Data Lake Insight (DLI).

2018-04-09

This is the sixth official release.

• Added the following sections:
  • Link to OSS on Alibaba Cloud
  • Link to DLI
  • To DLI
• Modified the following sections:
  • From Object Storage
  • From HBase/CloudTable
  • To OBS

2018-01-31

This is the fifth official release.

• Deleted the type parameter from the configs field.
• Modified the description of several link parameters and job parameters.
• Added a sample JSON file to each connector.
• Added a sample JSON file to each type of data source.
• Added the GaussDB connector to Link to a Relational Database.
• Added the following sections:
  • Before You Start
  • API Overview
  • Getting Started
• Deleted the following sections:
  • Common Message Headers
  • AK/SK Authentication
  • Common Return Values
  • Common Exception Response

2018-01-11

This is the fourth official release.

• Added the following sections:
  • Link to HDFS
  • Link to CloudTable
  • Link to Kafka
• Deleted the description of the datastore parameter and modified the description of the instances parameter in Creating a Cluster.
• Deleted the description of the datastore parameter and added the description of the version parameter in Querying the Cluster List.
• Deleted the description of the datastore parameter and added the description of the version parameter in Querying Cluster Details.
• Modified the value of the fromJobConfig.disConsumerStrategy parameter in From DIS.
• Modified Creating a Job in a Specified Cluster.
• Deleted the following sections:
  • Querying Versions
  • Querying Flavors
  • Create MRS Data Source
  • Querying MRS Data Source
  • Deleting MRS Data Source
  • Public Configuration Data Structures

2017-11-30

This is the third official release.

• Added the NAS, DIS, and Elasticsearch connectors.
• Added the NAS and DIS data sources to the job parameter description of source links.
• Added the NAS and Elasticsearch data sources to the job parameter description of destination links.

2017-10-31

This is the second official release.

• Replaced projectId with project_id in this document.
• Replaced datastoreId with datastore_id in this document.
• Replaced clusterId with cluster_id in this document.
• Added and modified the URI format and parameters in several sections.
• Added section "MongoDB Link".
• Added section "Common Exception Response".

2017-9-30

This is the first official release.