Updated on 2024-10-09 GMT+08:00

Common commands of the HDFS client

Using the HDFS Client

  1. Install a client. For details, see Installing a Client.
  2. Log in to the node where the client is installed as the client installation user.
  3. Run the following command to go to the client installation directory:

    cd /opt/client

  4. Run the following command to configure environment variables:

    source bigdata_env

  5. If the cluster is in security mode, run the following command to authenticate the user. In normal mode, user authentication is not required.

    kinit Component service user

  6. Run the HDFS Shell command. Example:

    hdfs dfs -ls /

Common HDFS Client Commands

The following table lists common HDFS client commands.

For more commands, see https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/CommandsManual.html#User_Commands.

Table 1 Common HDFS client commands

Command

Description

Example

hdfs dfs -mkdir Folder name

Used to create a folder.

hdfs dfs -mkdir /tmp/mydir

hdfs dfs -ls Folder name

Used to view a folder.

hdfs dfs -ls /tmp

hdfs dfs -put Local file on the client node Specified HDFS path

Used to upload a local file to a specified HDFS path.

hdfs dfs -put /opt/test.txt /tmp

Upload the /opt/test.txt file on the client node to the /tmp directory of HDFS.

hdfs dfs -get Specified file on HDFS Specified path on the client node

Used to download the HDFS file to the specified local path.

hdfs dfs -get /tmp/test.txt /opt/

Download the /tmp/test.txt file on HDFS to the /opt path on the client node.

hdfs dfs -rm -r -f Specified folder on HDFS

Used to delete a folder.

hdfs dfs -rm -r -f /tmp/mydir

hdfs dfs -chmod Permission parameter File directory

Used to configure the HDFS directory permission for a user.

hdfs dfs -chmod 700 /tmp/test