Help Center/
Cloud Data Migration/
Best Practices/
Case: IoV Big Data Service Migration to Cloud/
Using DES to Migrate Historical Data Generated One Month Ago
Updated on 2022-12-22 GMT+08:00
Using DES to Migrate Historical Data Generated One Month Ago
Migration Process
- Use a script to import the historical data generated one month ago to the DES Teleport box. For details about the operations related to DES Teleport boxes, see Data Express Service (DES).
- Use DES to deliver data to HUAWEI CLOUD data center.
- Use CDM to migrate data from DES to Object Storage Service (OBS).
- Use CDM to migrate data from OBS to MRS.
The operations on CDM are the same as those described in Using CDM to Migrate Data of the Last Month. File directories are transmitted in binary format and two clusters concurrently execute jobs.
Precautions
- If the migration affects the source HDFS cluster, manually stop the job.
- If a large number of jobs fail, perform the following operations:
- Check whether the DES Teleport box is fully written. If the Teleport box is fully written, clear the failed directories to ensure that the data written later is complete.
- Check the network connectivity.
- Check the source HDFS cluster. Check whether indicators are abnormal. If any indicator is abnormal, suspend the migration task.
Parent topic: Case: IoV Big Data Service Migration to Cloud
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbot