On this page

Question
Answer

Show all

Help Center/ MapReduce Service/ Component Operation Guide (Normal)/ Using ClickHouse/ ClickHouse FAQ/ How Do I Migrate Data from Hive/HDFS to ClickHouse?

How Do I Migrate Data from Hive/HDFS to ClickHouse?

Updated on 2024-12-11 GMT+08:00

View PDF

Question

How do I migrate Hive/HDFS data to ClickHouse?

Answer

You can export data from Hive as CSV files and import the CSV files to ClickHouse.

Export data from Hive as CSV files.
hive -e "select * from db_hive.student limit 1000"| tr "\t" "," > /data/bigdata/hive/student.csv;
Import the CSV files to the student_hive table in the default database of ClickHouse. There can be security risks if a command contains the authentication password. You are advised to disable the command recording function (history) before running the command.
clickhouse --client --port 9002 --password xxx -m --query='INSERT INTO default.student_hive FORMAT CSV' < /data/bigdata/hive/student.csv

Parent topic: ClickHouse FAQ

Previous topic: How Do I Do If the Disk Status Displayed in the System.disks Table Is fault or abnormal?

Next topic: An Error Is Reported in Logs When the Auxiliary ZooKeeper or Replica Data Is Used to Synchronize Table Data

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

Feedback

Feedback

Feedback

0/500

Selected Content

Submit selected content with the feedback