Updated on 2024-01-26 GMT+08:00

Node Mount Points

Check Item

Check whether inaccessible mount points exist on the node.

Solution

Scenario: There are inaccessible mount points on the node.

If network NFS (such as OBS, SFS, and SFS) is used by the node and the node is disconnected with the NFS server, the mount point would be inaccessible and all processes that access this mount point are suspended.

  1. Log in to the node.
  2. Run the following commands on the node in sequence:

    - df -h
    - for dir in `df -h | grep -v "Mounted on" | awk "{print \\$NF}"`;do cd $dir; done && echo "ok"

  3. If ok is returned, no problem occurs.

    Otherwise, start another terminal and run the following command to check whether the previous command is in the D state:
    - ps aux | grep "D "

  4. If a process is in the D state, the problem occurs. You can only reset the node to solve the problem. Reset the node and upgrade the cluster again. For details about how to reset a node, see Resetting a Node.

    Resetting a node will reset all node labels, which may affect workload scheduling. Before resetting a node, check and retain the labels that you have manually added to the node.