Hudi作为目的端时，实时网络连接主机信息未配置报错，错误信息包含关键字“IllegalArgumentException: java.net.UnknownHostException：{MRS主机信息}”怎么办？

问题描述

作业启动时出现异常，错误关键字为：“IllegalArgumentException: java.net.UnknownHostException: {MRS主机信息}”。

2025-07-28 10:24:31,895 INFO  com.huawei.clouds.dataarts.migration.mrs.auth.utils.SecurityPrincipalUtils [] - ### UGI Login security MRS Hadoop success.2025-07-28 10:24:31,896 INFO  com.huawei.clouds.dataarts.migration.connector.hudi.table.HoodieTableFactory [] - Set table path as [hdfs:///user/hive/warehouse/rds_source_tbl_961_0726]2025-07-28 10:24:31,938 INFO  com.huawei.clouds.dataarts.shaded.org.apache.hudi.common.table.HoodieTableMetaClient [] - Loading HoodieTableMetaClient from hdfs:///user/hive/warehouse/rds_source_tbl_961_07262025-07-28 10:24:36,041 WARN  org.apache.hadoop.hdfs.DFSUtilClient                         [] - Namenode for hacluster remains unresolved for ID 3. Check your hdfs-site.xml file to ensure namenodes are configured properly.2025-07-28 10:24:40,049 WARN  org.apache.hadoop.hdfs.DFSUtilClient                         [] - Namenode for hacluster remains unresolved for ID 4. Check your hdfs-site.xml file to ensure namenodes are configured properly.2025-07-28 10:24:40,451 WARN  org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory      [] - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.2025-07-28 10:24:41,601 INFO  org.apache.hadoop.io.retry.RetryInvocationHandler            [] - Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master3xkwh":8020; java.net.UnknownHostException: Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master3xkwh":8020; java.net.UnknownHostException; For more details see:  http://wiki.apache.org/hadoop/UnknownHost; For more details see:  http://wiki.apache.org/hadoop/UnknownHost, while invoking ClientNamenodeProtocolTranslatorPB.getFileInfo over us-node-master3xkwh:8020 after 2 failover attempts. Trying to failover after sleeping for 1646ms.2025-07-28 10:24:43,248 INFO  org.apache.hadoop.io.retry.RetryInvocationHandler            [] - Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master2gnec":8020; java.net.UnknownHostException: Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master2gnec":8020; java.net.UnknownHostException; For more details see:  http://wiki.apache.org/hadoop/UnknownHost; For more details see:  http://wiki.apache.org/hadoop/UnknownHost, while invoking ClientNamenodeProtocolTranslatorPB.getFileInfo over us-node-master2gnec:8020 after 3 failover attempts. Trying to failover after sleeping for 2114ms.2025-07-28 10:24:43,826 INFO  com.huawei.clouds.dataarts.migration.metrics.reporter.io.ObsMetricsFileWriter [] - Init metrics file writer, commit interval: 60000.2025-07-28 10:24:45,363 INFO  org.apache.hadoop.io.retry.RetryInvocationHandler            [] - Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master3xkwh":8020; java.net.UnknownHostException: Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master3xkwh":8020; java.net.UnknownHostException; For more details see:  http://wiki.apache.org/hadoop/UnknownHost; For more details see:  http://wiki.apache.org/hadoop/UnknownHost, while invoking ClientNamenodeProtocolTranslatorPB.getFileInfo over us-node-master3xkwh:8020 after 4 failover attempts. Trying to failover after sleeping for 9942ms.2025-07-28 10:26:54,750 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.TaskExecutorManager [] - Starting task manager redundancy check2025-07-28 10:26:54,750 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.TaskExecutorManager [] - Finished task manager redundancy check2025-07-28 10:27:07,891 INFO  org.apache.hadoop.io.retry.RetryInvocationHandler            [] - Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master2gnec":8020; java.net.UnknownHostException: Invalid host name: local host is: "flink-154257-7cf64557b7-5mwpb/172.31.208.57"; destination host is: "us-node-master2gnec":8020; java.net.UnknownHostException; For more details see:  http://wiki.apache.org/hadoop/UnknownHost; For more details see:  http://wiki.apache.org/hadoop/UnknownHost, while invoking ClientNamenodeProtocolTranslatorPB.getFileInfo over us-node-master2gnec:8020 after 11 failover attempts. Trying to failover after sleeping for 14048ms.2025-07-28 10:27:23,921 INFO  com.huawei.clouds.dataarts.migration.metrics.reporter.io.ObsMetricsFileCleaner [] - Start clean metrics Dir2025-07-28 10:27:24,769 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.TaskExecutorManager [] - Starting task manager redundancy check2025-07-28 10:27:24,769 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.TaskExecutorManager [] - Finished task manager redundancy check  http://wiki.apache.org/hadoop/UnknownHost; For more details see:  http://wiki.apache.org/hadoop/UnknownHost, while invoking ClientNamenodeProtocolTranslatorPB.getFileInfo over us-node-master2gnec:8020 after 17 failover attempts. Trying to failover after sleeping for 11560ms.2025-07-28 10:29:06,334 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.

原因分析

由于实时网络连接中主机信息未配置，导致配置文件下载失败。作业未报错，但打印了info级别的异常信息，提示MRS相关域名为UnknownHost。

解决方案

在实时网络连接中添加主机信息，详情请参考网络配置流程。