Help Center/ Cloud Data Migration/ FAQs/ Troubleshooting/ What Should I Do If "Error occurs during loader run" Is Reported During Migration from PostgreSQL to Hive?
Updated on 2023-06-21 GMT+08:00
View PDF
Share

What Should I Do If "Error occurs during loader run" Is Reported During Migration from PostgreSQL to Hive?

Symptom

During data migration from PostgreSQL to Hive, "Error occurs during loader run" is reported.

Fault Analysis

  1. Check the errors in the CDM log of the previous day: 2021-09-29 10:35:32,638 ERROR LocalJobRunner Map Task #13 #loader [org.apache.sqoop.connector.hive.hiveWriter.HiveOrcWriter:83] Create file system error.

java.nio.file.AccessDeniedException: obs-itotshujuruhu-bingxing-fangcongyang: doesBucketExist on obs-itotshujuruhu-bingxing-fangcongyang: com.obs.services.exception.ObsException: Error message:Request Error.OBS servcie Error Message. -- ResponseCode: 403

  1. According to the errors "hiveWriter.HiveOrcWriter:83] Create file system error" and "Error.OBS servcie Error Message. -- ResponseCode: 403", an error occurs during synchronization of tables from Hive to the OBS directory. OBS Support may be set to No during the connector creation.
  2. Check the connector configuration. It is found that OBS Support is set to No. This parameter specifies whether OBS storage is supported. If Hive table data is stored in OBS, the value must be set to Yes.

Solution

Set OBS Support to Yes and enter the password.

Parent topic: Troubleshooting