Updated on 2024-12-11 GMT+08:00

Optimization for Unstable HDFS Network

Scenario

Clients probably encounter running errors when the network is not stable. Users can adjust the following parameter values to improve the running efficiency.

Configuration Description

Go to the All Configurations page of HDFS and enter a parameter name in the search box by referring to Modifying Cluster Service Configuration Parameters.

Table 1 Parameter description

Parameter

Description

Default Value

ha.health-monitor.rpc-timeout.ms

Timeout interval during the NameNode health check performed by ZKFC. Increasing this value can prevent dual active NameNodes and reduce the probability of application running exceptions on clients.

Unit: millisecond. Value range: 30,000 to 3,600,000

180,000

ipc.client.connect.max.retries.on.timeouts

Number of retry times when the socket connection between a server and a client times out.

Value range: 1 to 256

45

ipc.client.connect.timeout

Timeout interval of the socket connection between a client and a server. Increasing the value of this parameter increases the timeout interval for setting up a connection.

Unit: millisecond. Value range: 1 to 3,600,000

20,000