gds_check

Context

gds_check is used to check the GDS deployment environment, including the OS parameters, network environment, and disk usage. It also supports the recovery of system parameters. This helps detect potential problems during GDS deployment and running, improving the execution success rate.

Precautions

• Set environment variables before executing the script. For details, see "Importing Data > Using a Foreign Table to Import Data In Parallel > Installing, Configuring, and Starting GDS" in the Developer Guide.
• The script must be executed in the Python 3 environment.
• This script must be run by user root.
• The -t and --host parameters must be specified.
• If --host specifies the network address 0.0.0.0 or 127.0.0.1, the MTU and NIC multi-queue are not checked.
• The NIC multi-queue check and recovery require that the NIC be at least 10 GE.
• The passwords of all nodes specified by the --host parameter must be the same so that the script can perform remote check successfully.
• During the recovery, set the OS configuration items according to the recommended values. For details, see the following table.

  Table 1 OS configuration items

  Parameter	Recommended Value
  net.core.somaxconn	65535
  net.ipv4.tcp_max_syn_backlog	65535
  net.core.netdev_max_backlog	65535
  net.ipv4.tcp_retries1	5
  net.ipv4.tcp_retries2	12
  net.ipv4.ip_local_port_range	26000 to 65535
  MTU	1500
  net.core.wmem_max	21299200
  net.core.rmem_max	21299200
  net.core.wmem_default	21299200
  net.core.rmem_default	21299200
  max handler	1000000
  vm.swappiness	10

  Table 2 Disk check

  Check Item	Warning
  Disk space usage	Greater than or equal to 70% and less than 90%
  Inode usage	Greater than or equal to 70% and less than 90%

  Table 3 Network conditions

  Check Item	Error
  Network connectivity	100% packet loss
  NIC multi-queue	When NIC multi-queue is enabled and different CPUs are bound, fix can be modified.

Syntax

• check command

  gds_check -t check --host [/path/to/hostfile | ipaddr1,ipaddr2...] --ping-host [/path/to/pinghostfile | ipaddr1,ipaddr2...] [--detail]

• fix command

  gds_check -t fix --host [/path/to/hostfile | ipaddr1,ipaddr2...] [--detail]

Parameter Description

• -t

  Operation type, indicating check or recovery.

  The value can be check or fix.

• --host

  IP addresses of the nodes to be checked or recovered.

  Value: IP address list in the file or character string format

  • File format: Each IP address occupies a row, for example:

    192.168.1.200

    192.168.1.201

  • Character string format: IP addresses are separated by commas (,), for example:

    192.168.1.200,192.168.1.201

• --ping-host

  Destination IP address for the network ping check on each node to be checked.

  Value: IP address list in the file or character string format. Generally, the value is the IP address of a DN, CN, or gateway.

  • File format: Each IP address occupies a row, for example:

    192.168.2.200

    192.168.2.201

  • Character string format: IP addresses are separated by commas (,), for example:

    192.168.2.200,192.168.2.201

• --detail

  Displays detailed information about check and repair items and saves the information to logs.

• -V

  Version information.

• -h, --help

  Help information.

Examples

Perform a check. Both --host and --ping-host are in character string format.

gds_check -t check --host 192.168.1.100,192.168.1.101 --ping-host 192.168.2.100

Perform a check. --host is in character string format and --ping-host is in file format.

gds_check -t check --host 192.168.1.100,192.168.1.101 --ping-host /home/gds/iplist

cat /home/gds/iplist
192.168.2.100
192.168.2.101

Perform a check. --host is in file format and --ping-host is in character string format.

gds_check -t check --host  /home/gds/iplist --ping-host 192.168.1.100,192.168.1.101

Perform a recovery. --host is in character string format.

gds_check -t fix --host 192.168.1.100,192.168.1.101

Run the following command to perform the check, print the detailed information, and save the information to logs:

gds_check -t check --host 192.168.1.100 --detail

Run the following command to perform the repair, print the detailed information, and save the information to logs:

gds_check -t fix --host 192.168.1.100 --detail