Updated on 2024-07-29 GMT+08:00

Importing Backup Files from an OBS Bucket

Scenario

Use the DCS console to migrate backup data to DCS for Redis.

Simply download the source Redis backup data and then upload the data to an OBS bucket in the same region as the target DCS Redis instance. After you have created a migration task on the DCS console, DCS will read data from the OBS bucket and data will be migrated to the target instance.

.aof, .rbb, .zip, and .tar.gz files can be uploaded to OBS buckets. You can directly upload .aof and .rdb files or compress them into .zip or .tar.gz files before uploading.

Prerequisites

  • The OBS bucket must be in the same region as the target DCS Redis instance.
  • The data files to be uploaded must be in .aof, .rdb, .zip, or .tar.gz formats. .zip files must contain .aof or .rdb files.
  • To migrate data from a single-node or master/standby Redis instance of other cloud vendors, create a backup task and download the backup file.
  • To migrate data from a cluster Redis instance of other cloud vendors, download all backup files and upload all of them to the OBS bucket. Each backup file contains data for a shard of the instance.

Step 1: Prepare the Target DCS Redis Instance

  • If a DCS Redis instance is not available, create one first. For details, see Creating a DCS Redis Instance.
  • If a DCS Redis instance is available, you do not need to create a new one. However, you can clear the instance data before the migration.
    • If the target instance is Redis 4.0 and later, clear the data by referring to Clearing DCS Instance Data.
    • If the target instance is a DCS Redis 3.0 instance, run the FLUSHALL command to clear data.
    • If the target instance data is not cleared before the migration and the source and target instances contain the same key, the key in the target instance will be overwritten by the key in the source instance after the migration.
  • Redis is backward compatible. The target instance version must be the same as or later than the source instance version.

Step 2: Create an OBS Bucket and Upload Backup Files

  1. Create an OBS bucket.

    1. Log in to the OBS Console and click Create Bucket.
    2. Select a region.

      The OBS bucket must be in the same region as the target DCS Redis instance.

    3. Specify Bucket Name.

      The bucket name must meet the naming rules specified on the console.

    4. Set Storage Class to Standard, Warm or Cold.
    5. Set Bucket Policy to Private, Public Read, or Public Read and Write.
    6. Configure default encryption.
    7. Click Create Now.

  2. Upload the backup data files to the OBS bucket by using OBS Browser+.

    If the backup file to be uploaded does not exceed 5 GB, upload the file using the OBS console by referring to step 3.

    If the backup file to be uploaded is larger than 5 GB, perform the following steps to upload the file using OBS Browser+.

    1. Download OBS Browser+.

      For details, see section "Downloading OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+).

    2. Install OBS Browser+.

      For details, see section "Installing OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+).

    3. Log in to OBS Browser+.

      For details, see section "Logging In to OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+).

    4. Create a bucket.

      For details, see the OBS Console Operation Guide > "Getting Started" > "Creating a Bucket".

    5. Upload backup data.

  3. On the OBS console, upload the backup data files to the OBS bucket.

    Perform the following steps if the backup file size does not exceed 5 GB:
    1. In the bucket list, click the name of the created bucket.
    2. In the navigation pane, choose Objects.
    3. On the Objects tab page, click Upload Object.
    4. Upload the objects.

      To upload objects, drag files or folders to the Upload Object area or click add file. A maximum of 100 files can be uploaded at a time. The total size cannot exceed 5 GB.

      Figure 1 Uploading an object
    5. (Optional) Select KMS encryption to encrypt the file you want to upload.
    6. Click Upload.

Step 3: Create a Migration Task

  1. Log in to the DCS console.
  2. Click in the upper left corner and select a region and a project.
  3. In the navigation pane, choose Data Migration.
  4. Click Create Backup Import Task.
  5. Specify Task Name and Description.
  6. Select OBS Bucket as the data source and then select the OBS bucket to which you have uploaded backup files.

    You can upload files in the .aof, .rdb, .zip, or .tar.gz format.

    Figure 2 Importing backup files

  7. In the Backup Files area, click Add Backup and select the backup files to be migrated.
  8. Select the target DCS Redis instance prepared in Step 1: Prepare the Target DCS Redis Instance.
  9. Enter the password of the target instance. Click Test Connection to verify the password. If the instance is not password-protected, click Test Connection directly.
  10. Click Next.
  11. Confirm the migration task details and click Submit.

    Go back to the data migration task list. After the migration is successful, the task status changes to Successful.