Help Center> Data Warehouse Service (DWS)> Management Guide> Data Integration> Migration Task Management
Updated on 2024-06-14 GMT+08:00
View PDF

Migration Task Management

Migration task management allows you to migrate data from object storage services of other cloud vendors to Cloud Object Storage Service (OBS) online. You can create migration tasks to migrate data with bucket size lower than 3 TB or objects fewer than 5 million. For details, see Creating a Migration Task. If the data volume in a bucket is greater than 3 TB or the number of objects is greater than 5 million, you are advised to migrate data by referring to Creating a Migration Task Group.

If the current console does not support this feature, contact technical support.

Creating a Migration Task

  1. Log in to the GaussDB(DWS) management console.
  2. In the navigation tree, choose Data > Data Integration > Migration Task Management.
  3. In the migration task list, click Create Migration Task in the upper right corner.
  4. Set the parameters at the source and destination ends and select the service statement to create migration task, as shown in the following table.

    Table 1 Migration task parameters

    Source/Destination

    Parameter for tenant migration

    Description

    Source End

    Data source

    You can select a data source. The supported data sources are listed on the console.

    Access Key (AK)

    AK for the source bucket. The maximum length is 100 characters. It is used to identify the user who accesses the system.

    Secret Access Key (SK)

    SK for the source bucket. The maximum length is 100 characters. This parameter is used for key authentication.

    Bucket

    Name of the source bucket.

    Prefix

    Prefix of the migration object. If the prefix ends with a slash (/), the migration object is a folder. If the prefix does not end with a slash (/), the migration object is a file. If the migration object is a bucket, leave this parameter blank.

    Destination

    Bucket

    Name of the destination bucket.

    Prefix

    Prefix of the path of the destination bucket. The migrated content is stored in folders with this prefix.

Migration Task Management

  1. Log in to the GaussDB(DWS) management console.
  2. In the navigation tree, choose Data > Data Integration > Migration Task Management.
  3. Go to migration task management page. In the migration task list, locate the row that contains the specified migration task and perform the corresponding operation in the Operation column.

    Table 2 Migration task management operations

    Operation

    Description

    Stop

    This operation stops a migration task.

    NOTE:

    You can stop a migration task during the task execution. After the migration is complete, this button is unavailable.

    Start

    After you click the Start button, a dialog box is displayed, where you can enter the source AK and source SK to restart the stopped migration task.

    Delete

    This operation deletes a migration task.

Creating a Migration Task Group

  1. Log in to the GaussDB(DWS) management console.
  2. In the navigation tree, choose Data > Data Integration > Migration Task Management.
  3. Click Migration Task Groups and click Create Migration Task Group in the upper right corner.
  4. Enter the parameters related to the source and destination buckets by referring to Table 1 and select the service statement to create a migration task group.

Migration Task Group Management

  1. Log in to the GaussDB(DWS) management console.
  2. In the navigation tree, choose Data > Data Integration > Migration Task Management.
  3. Go to the migration task management page, click the Migration Task Groups tab, and perform operations in the Operation column corresponding to the specified migration task group.

    Table 3 Migration task group management operations

    Operation

    Description

    Stop

    The operation stops a migration task group.

    Start

    After you click the Start button, a dialog box is displayed, where you can enter the source AK and source SK to restart a stopped migration task group.

    Restart

    After you click the Restart button, a dialog box is displayed, where you can enter the source AK, source SK, and migration scope (all objects or failed objects) to restart an abnormal migration task group.

    NOTE:

    You can only restart an abnormal migration task group.

    Delete

    This operation deletes a migration task group.

Parent topic: Data Integration