Migrating Archived Data

Updated on 2024-12-19 GMT+08:00

View PDF

Scenarios

This section describes how to quickly migrate archive data from source buckets to Huawei Cloud OBS buckets. Using OMS directly to migrate archive data takes a long time.

CAUTION:

If you do not restore archive objects in advance, and if you rely entirely on the automatic restoration function of OMS, it takes 1 to 5 minutes to restore an archived object, depending on the source object storage services. This can significantly slow down the migration.
For OBS buckets with the direct reading function enabled, even though the archived data in these OBS buckets can be directly downloaded without being restored in advance, OMS cannot migrate such data because its storage class is not changed.
You will be billed for enabling direct reading for your source bucket and enabling OMS to automatically restore archived data in the source bucket. To learn about OBS billing details, see Pricing Details.
Before you migrate archive data, you are advised to set the storage class of the destination bucket to Standard. After the migration is complete, confirm that the migrated data is correct, and change the storage class of the destination bucket to Archive.

Prerequisites

You have registered a HUAWEI ID and enabled Huawei Cloud services.
You have obtained the AK/SK pairs and required permissions for the source and destination platform accounts.
- The source platform account needs the permissions for:
  - Listing buckets
  - Obtaining bucket locations
  - Listing objects
  - Obtaining object metadata
  - Obtaining object content
  For details about how to obtain these permissions, see Source Permissions.
- The destination platform account needs the permissions for:
  - Listing buckets
  - Obtaining bucket locations
  - Listing objects
  - Obtaining object metadata
  - Obtaining object content
  - Listing uploaded parts
  - Restoring archive objects
  For details about how to obtain these permissions, see Destination Permissions.
You have created at least one bucket on OBS.

Procedure

Use a tool or the source platform management console to restore the archive data before migration. It is recommended that you configure a long restoration duration.
- If the source bucket is not on Huawei Cloud, follow the restoration methods provided by the source cloud service vendors.
- If the source bucket is on Huawei Cloud, use obsutil to restore the archive data. For details, see Restoring Objects from OBS Archive.
Sign in to the console.
Click Service List. Under Migration, click Object Storage Migration Service.

The Object Storage Migration Service page is displayed.
Create a migration task or migration task group to migrate the source data.
- If there is more than 3 TB of data or more than 5 million objects to migrate, create a migration task group. For details, see Creating a Migration Task Group.
- If there is not a lot of source data, create a migration task. For details, see Creating a Migration Task.
  CAUTION:
  
  It is recommended that you enable the archive data restoration function of OMS. OMS will automatically restore and migrate the archive data that is not restored in advance.