Updated on 2024-04-19 GMT+08:00

Migrating Archive Data

Scenarios

This section describes how to quickly migrate archive data from source buckets to Huawei Cloud OBS buckets. Using OMS directly to migrate archive data takes a long time.

  • If you do not restore archive objects in advance, and if you rely entirely on the automatic restoration function of OMS, it takes 1 to 5 minutes to restore each object, depending on the source object storage services. This can significantly slow down the migration.
  • For OBS buckets with the direct reading function enabled, the archive data in these OBS buckets can be directly downloaded without being restored in advance. But OMS cannot migrate such data.
  • Direct reading may be a billable function of your source object storage service. Nevertheless, you will be billed for enabling OMS to call or directly using the direct reading function of Huawei Cloud OBS. For details, see Pricing Details.
  • Before you migrate archive data, you are advised to set the storage class of the destination bucket to Standard. After the migration is complete, confirm that the migrated data is correct, and change the storage class of the destination bucket to Archive.

Prerequisites

  • You have registered a HUAWEI ID and enabled Huawei Cloud services.
  • You have obtained the AK/SK pairs and required permissions for the source and destination platform accounts.
    • The source platform account needs the permissions for:
      • Listing buckets
      • Obtaining bucket locations
      • Listing objects
      • Obtaining object metadata
      • Obtaining object content

      For details about how to obtain these permissions, see Source Permissions.

    • The destination platform account needs the permissions for:
      • Listing buckets
      • Obtaining bucket locations
      • Listing objects
      • Obtaining object metadata
      • Obtaining object content
      • Listing uploaded parts
      • Restoring archive objects

      For details about how to obtain these permissions, see Destination Permissions.

  • You have created at least one bucket on OBS.

Procedure

  1. Use a tool or the source platform management console to restore the archive data before migration. It is recommended that you configure a long restoration duration.

    • If the source bucket is not on Huawei Cloud, follow the restoration methods provided by the source cloud service vendors.
    • If the source bucket is on Huawei Cloud, use obsutil to restore the archive data. For details, see Restoring Objects from OBS Archive.

  2. Log in to the management console.
  3. Click Service List. Under Migration, click Object Storage Migration Service.

    The Object Storage Migration Service page is displayed.

  4. Create a migration task or migration task group to migrate the source data.

    • If there is more than 3 TB of data or more than 5 million objects to migrate, create a migration task group. For details, see Creating a Migration Task Group.
    • If there is not a lot of source data, create a migration task. For details, see Creating a Migration Task.

      It is recommended that you enable the archive data restoration function of OMS. OMS will automatically restore and migrate the archive data that is not restored in advance.