Help Center/ Distributed Cache Service/ User Guide (Ankara Region)/ User Guide/ Migrating Data with DCS/ Importing Backup Files/ Importing Backup Files from an OBS Bucket
Updated on 2024-11-26 GMT+08:00
View PDF
Share

Importing Backup Files from an OBS Bucket

Scenario

Use the DCS console to migrate backup data to DCS for Redis.

Simply download the source Redis backup data and then upload the data to an OBS bucket in the same region as the target DCS Redis instance. After you have created a migration task on the DCS console, DCS will read data from the OBS bucket and data will be migrated to the target instance.

.aof, .rbb, .zip, and .tar.gz files can be uploaded to OBS buckets. You can directly upload .aof and .rdb files or compress them into .zip or .tar.gz files before uploading.

Prerequisites

  • The OBS bucket must be in the same region as the target DCS Redis instance.
  • The data files to be uploaded must be in .aof, .rdb, .zip, or .tar.gz formats. .zip files must contain .aof or .rdb files.
  • To migrate data from a single-node or master/standby Redis instance of other cloud vendors, create a backup task and download the backup file.
  • To migrate data from a cluster Redis instance of other cloud vendors, download all backup files and upload all of them to the OBS bucket. Each backup file contains data for a shard of the instance.
  1. Importing backups generated by a later-version Redis instance to an earlier one may fail.
  2. Before importing backup files, ensure that resource-intensive commands (such as FLUSHALL, KEYS, and HGETALL) have been disabled on the target Redis.
  3. The Redis memory usage of a single .rdb backup file must be less than 10 GB.
  4. If the backup file contains multi-DB data, its database count cannot exceed what is supported by the target Redis.
  5. Multi-DB backup files generated from Proxy Cluster instances cannot be imported.

Preparing the Target DCS Redis Instance

  • If a DCS Redis instance is not available, create one first. For details, see Creating a DCS Redis Instance.
  • If a DCS Redis instance is available, you do not need to create a new one. However, you can clear the instance data before the migration.
    • If the target instance is Redis 4.0 and later, clear the data by referring to Clearing DCS Instance Data.
    • If the target instance is a DCS Redis 3.0 instance, run the FLUSHALL command to clear data.
    • If the target instance data is not cleared before the migration and the source and target instances contain the same key, the key in the target instance will be overwritten by the key in the source instance after the migration.
  • Redis is backward compatible. The target instance version must be the same as or later than the source instance version.

Creating an OBS Bucket and Uploading Backup Files

  1. Create an OBS bucket.

    1. Log in to the OBS Console and click Create Bucket.
    2. Select a region.

      The OBS bucket must be in the same region as the target DCS Redis instance.

    3. Specify Bucket Name.

      The bucket name must meet the naming rules specified on the console.

    4. Set Bucket Policy to Private, Public Read, or Public Read and Write.
    5. Click Create Now.

  2. Upload the backup data files to the OBS bucket by using OBS Browser+.

    If the backup file to be uploaded does not exceed 5 GB, upload the file using the OBS console by referring to step 3.

    If the backup file to be uploaded is larger than 5 GB, perform the following steps to upload the file using OBS Browser+.

    1. Download OBS Browser+.

      For details, see section "Downloading OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+) > "Getting Started".

    2. Install OBS Browser+.

      For details, see section "Installing OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+) > "Getting Started".

    3. Log in to OBS Browser+.

      For details, see section "Logging In to OBS Browser+" in Object Storage Service (OBS) Tools Guide (OBS Browser+) > "Getting Started".

    4. Create a bucket.
    5. Upload backup data.

  3. On the OBS console, upload the backup data files to the OBS bucket.

    Perform the following steps if the backup file size does not exceed 5 GB:
    1. In the bucket list, click the name of the created bucket.
    2. In the navigation pane, choose Objects.
    3. On the Objects tab page, click Upload Object.
    4. Upload the objects.

      To upload objects, drag files or folders to the Upload Object area or click add file. A maximum of 100 files can be uploaded at a time. The total size cannot exceed 5 GB.

    5. Click Upload.

Creating a Migration Task

  1. Log in to the DCS console.
  2. Click in the upper left corner and select a region and a project.
  3. In the navigation pane, choose Data Migration.
  4. Click Create Backup Import Task.
  5. Specify Task Name and Description.
  6. Select OBS Bucket as the data source and then select the OBS bucket to which you have uploaded backup files.

    You can upload files in the .aof, .rdb, .zip, or .tar.gz format.

  7. In the Backup Files area, click Add Backup and select the backup files to be migrated.
  8. Select the target DCS Redis instance prepared in Preparing the Target DCS Redis Instance.
  9. Enter the password of the target instance. Click Test Connection to verify the password. If the instance is not password-protected, click Test Connection directly.
  10. Click Next.
  11. Confirm the migration task details and click Submit.

    Go back to the data migration task list. After the migration is successful, the task status changes to Successful.

    If the error "DCS.4104 The DCS instance is recovering from an internal fault. Please try again." is displayed, contact O&M personnel.

Parent topic: Importing Backup Files