Importing Backup Files from an OBS Bucket

Scenario

Use the DCS console to migrate Redis data from Redis of other vendors or self-hosted Redis to DCS for Redis.

Simply download the source Redis data and then upload the data to an OBS bucket in the same region as the target DCS Redis instance. After you have created a migration task on the DCS console, DCS will read data from the OBS bucket and data will be migrated to the target instance.

.aof, .rbb, .zip, and .tar.gz files can be uploaded to OBS buckets. You can directly upload .aof and .rdb files or compress them into .zip or .tar.gz files before uploading.

Prerequisites

• The OBS bucket must be in the same region as the target DCS Redis instance.
• The data files to be uploaded must be in the .aof, .rdb, .zip, or .tar.gz format.
• To migrate data from a single-node or master/standby Redis instance of other cloud vendors, create a backup task and download the backup file.
• To migrate data from a cluster Redis instance of other cloud vendors, download all backup files and upload all of them to the OBS bucket. Each backup file contains data for a shard of the instance.
• .rdb backup files of self-hosted Redis 5.0 cannot be imported. .rdb backup files of self-hosted Redis 3.0 or 4.0 can be exported using redis-cli. .rdb files of other cloud Redis can be exported only by creating backup tasks, and cannot be exported by running commands in redis-cli.
• Redis Cluster instances only support .rdb files and do not support .aof files.

Step 1: Prepare the Target DCS Redis Instance

• If a DCS Redis instance is not available, create one first. For details, see Creating a DCS Redis Instance.
• If a DCS Redis instance is available, you do not need to create a new one. However, you must clear the instance data before the migration.
  • If the target instance is Redis 4.0 or 5.0, clear the data by referring to Clearing DCS Instance Data.
  • If the target instance is a DCS Redis 3.0 instance, run the FLUSHALL command to clear data.

You can use a DCS Redis 3.0, 4.0, or 5.0 instance as the target instance.

Step 2: Create an OBS Bucket and Upload Backup Files

1. Create an OBS bucket.
   1. Log in to the OBS Console and click Create Bucket.
   2. Select a region.

      The OBS bucket must be in the same region as the target DCS Redis instance.

   3. Specify Bucket Name.

      The bucket name must meet the naming rules specified on the console.

   4. Set Storage Class to Standard, Warm or Cold.
   5. Set Bucket Policy to Private, Public Read, or Public Read and Write.
   6. Configure default encryption.
   7. Click Create Now.

2. Upload the backup data files to the OBS bucket by using OBS Browser+.

   If the backup file to be uploaded does not exceed 5 GB, upload the file using the OBS console by referring to step 3.

   If the backup file to be uploaded is larger than 5 GB, perform the following steps to upload the file using OBS Browser+.

   1. Download OBS Browser+.

      For details, see section "Downloading OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+).

   2. Install OBS Browser+.

      For details, see section "Installing OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+).

   3. Log in to OBS Browser+.

      For details, see section "Logging In to OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+).

   4. Creates a bucket.
   5. Upload backup data.

3. On the OBS console, upload the backup data files to the OBS bucket.
   Perform the following steps if the backup file size does not exceed 5 GB:

   1. In the bucket list, click the name of the created bucket.
   2. In the navigation pane, choose Objects.
   3. On the Objects tab page, click Upload Object.
   4. A maximum of 100 files can be uploaded at a time. The total size cannot exceed 5 GB.

      To upload objects, drag files or folders to the Upload Object area or click add file.

   5. Click Upload.

Step 3: Create a Migration Task

1. Log in to the DCS console.
2. Click in the upper left corner and select a region and a project.
3. In the navigation pane, choose Data Migration.
4. Click Create Backup Import Task.
5. Specify Task Name and Description.
6. Select OBS Bucket as the data source and then select the OBS bucket to which you have uploaded backup files.
   

   You can upload files in the .aof, .rdb, .zip, or .tar.gz format.

7. Select the backup files whose data is to be migrated.
8. Select the target DCS Redis instance prepared in Step 1: Prepare the Target DCS Redis Instance.
9. Enter the password of the target instance. Click Test Connection to verify the password.
10. Click Next.
11. Confirm the migration task details and click Submit.

    Go back to the data migration task list. After the migration is successful, the task status changes to Successful.