Help Center/ ROMA Connect/ Troubleshooting/ Common Data Integration Tasks/ Error Message "could only be written to 0 of the 1 minReplication nodes. There are 2 datanode(s) running and 2 node(s) are excluded in this operation" Is Reported at the Destination During Data Integration from MySQL to MRS Hive
Updated on 2022-02-21 GMT+08:00

Error Message "could only be written to 0 of the 1 minReplication nodes. There are 2 datanode(s) running and 2 node(s) are excluded in this operation" Is Reported at the Destination During Data Integration from MySQL to MRS Hive

Cause Analysis

All HDFS cluster nodes are bound to EIPs. When an MRS Hive data source is created, EIPs are used as all IP addresses in the uploaded configuration file, and IP addresses and hostnames are configured in Hosts. However, when the file is uploaded, the IP address of the node returned by the HDFS master node is an intranet IP address. As a result, the connection fails and therefore the FDI task fails to be executed.

Solution

Add the dfs.client.use.datanode.hostname configuration item to the hdfs-site.xml file uploaded during MRS Hive data source creation and set its value to true. Then, upload the modified configuration file and create the MRS Hive data source again.