Migrating Local Data to OBS

Background

Conventional on-premises storage servers cannot meet the storage demands for massive amounts of data. The main reasons are as follows:

• Storage capacity is subject to hardware devices. If the storage capacity becomes insufficient, you need to purchase disks and expand the capacity manually.
• The initial deployment requires high investments and a long construction period, but it quickly lags behind as enterprise services change so fast.
• Network information vulnerabilities, technical vulnerabilities, and unintended operations may result in security risks.

In contrast, OBS provides massive, stable, and secure cloud storage capabilities. With OBS, you do not need to worry about the storage capacity because it can be expanded infinitely. OBS can store unstructured data of any type and size. OBS ensures high stability and security for your data, featuring a multi-level reliability architecture, server-side encryption, log management, and permission control. In terms of the cost, OBS is available upon service subscription, eliminating the need for the investment in physical server deployment and maintenance.

Huawei Cloud provides diverse migration solutions to help you migrate data from your on-premises storage servers to OBS in a cost-effective, secure, and efficient manner. You can select a suitable migration solution according to your data volume, time arrangement, and budget.

Migration Solutions

Table 1 describes the migration solutions provided by Huawei Cloud.

Using OBS Tools to Migrate Data

OBS provides various client tools, such as OBS Browser+ and obsutil, to migrate hundreds of gigabytes local data to OBS. You are advised to migrate data during off-peak hours so as to minimize the impact on major services on the public network.

For details about the scenarios and operation guidelines of each tool, see OBS Tools Guide.

Using CDM to Migrate Data

CDM provides batch data migration services for homogeneous and heterogeneous data sources. By creating scheduled jobs, CDM connects data sources, such as file systems, databases, and object storage on the on-premises storage servers, to Huawei Cloud OBS. In this way, local data can be migrated to OBS periodically and automatically.

Using Disk-based DES to Migrate Data

Disk-based Data Express Service (DES) allows you to deliver data disks (such as USB flash drives and eSATA disks) to a Huawei Cloud data center offline, achieving efficient data transmission. Disk-based DES is suitable for migrating data less than 30 TB.

Figure 2 Migrating data to OBS using disk-based DES

1. Create an OBS bucket.

   Create a bucket on OBS Console or OBS Browser+ for storing data.

2. Create a disk-based DES order.

   Log in to DES Console and create a disk-based DES order. Import the provided signature file to a local data disk and send the disk to a Huawei Cloud data center.

3. Start data transmission.

   After receiving the disk, a Huawei Cloud data center administrator mounts the disk to a physical server. Then you will receive an SMS message to notify you of inputting the access keys (AK and SK) to start data uploading. After data transmission is complete, you can view the transmission result on both DES Console and OBS Console. The Huawei Cloud data center will send your disk back afterwards.

For details, see Detailed Instructions on Using Disks.

Using Teleport-based DES to Migrate Data

Teleport is specially designed for migrating data (between 30 TB and 500 TB) to OBS offline. It is dust- and water-proof and resistant to vibration and crush. With sound security protection mechanisms (such as GPS locking and data encryption), Teleport securely and efficiently migrates data at scale.

Figure 3 Migrating data to OBS using Teleport-based DES

1. Create an OBS bucket.

   Create a bucket on OBS Console or OBS Browser+ for storing data.

2. Create a Teleport-based DES order.

   Select Teleport-based DES to create an order.

3. Receive and import data to the Teleport.

   After the DES order is created successfully, you will receive the Teleport sent by a Huawei Cloud data center. Connect the Teleport to your data server, import the data to the Teleport, and send the Teleport to the Huawei Cloud data center.

4. Start data transmission.

   After the Huawei Cloud data center receives the Teleport, you can enter the access keys on DES Console to transmit data from the Teleport to a specific OBS bucket. After data transmission is complete, you can view the transmission result on both DES Console and OBS Console.

For details, see Detailed Instructions on Using Teleport.

Using a Direct Connect Connection to Migrate Data

Direct Connect connects your data center to Huawei Cloud, so that you can upload local data directly to Huawei Cloud OBS. Direct Connect provides low-latency and high-bandwidth services, which is suitable for you to upload data to OBS at any time, and is therefore recommended when local data needs to be migrated to OBS frequently or in real time.

Figure 4 Migrating data to OBS using a Direct Connect connection

1. Create an OBS bucket.

   Log in to OBS Console and create one or more buckets.

2. Enable Direct Connect.

   Log in to Direct Connect Console, fill in the application form and submit an order. After the administrator approves the application, you can pay for the order and contact the carrier for physical line connections. Huawei engineers will assist in configuring the connection. For details, see Enabling Direct Connect.

3. Start data transmission.

   After Direct Connect is enabled, upload your local data to OBS using OBS Console, relevant tools, APIs, or SDKs.