Help Center/ DataArts Studio/ Best Practices/ Migration of IoV Big Data to the Lake Without Loss/ Migration Preparation
Updated on 2024-08-30 GMT+08:00
View PDF
Share

Migration Preparation

Prerequisites

  • The CDH HBase version is earlier than or equal to the MRS HBase version.
  • No write, split, or merge operations can be performed on the tables that are being migrated.
  • A Direct Connect connection has been established between the CDH cluster and Huawei Cloud Virtual Private Cloud (VPC).

Migration Process

  1. Estimate the amount of data to be migrated and the migration duration.
  2. Output the detailed data tables, the number and sizes of files to be migrated for subsequent verification.
  3. Configure migration tasks in batches to ensure the migration progress and speed.
  4. Check the number and sizes of files.
  5. Restore the HBase table on MRS and verify the restoration.

Required Information

Item

Information

Description

Example Value

DES Teleport

Mount address

Address to which the DES Teleport box is mounted on the customer's VM

//IP address of the VM/huawei

DeviceManager

Storage management system of the DES Teleport box, which is related to the management IP address

https://Management IP address:8088/deviceManager/devicemanager/login/login.html

Username

Username for logging in to DeviceManager

admin

Password

Password for logging in to DeviceManager

-

CDH cluster

NameNode IP

IP address of the active NameNode in the CDH cluster

192.168.2.3

HDFS port

The default port number is 9000.

9000

HDFS URI

NameNode URI of HDFS in the CDH cluster

hdfs://192.168.2.3:9000

OBS

OBS endpoint

Endpoint of OBS

obs.ap-southeast-1.myhuaweicloud.com

OBS bucket

OBS bucket that stores historical data one month ago of the CDH cluster

cdm

AK/SK

AK and SK for accessing OBS

-

MRS

Manager IP

IP address of MRS Manager

192.168.3.11