Updated on 2024-08-16 GMT+08:00

Viewing the HDFS Application Commissioning Result

Scenario

After HDFS application running is complete, you can obtain the running status by viewing the running result or HDFS logs.

Procedure

  1. Viewing running results to learn application running status
    • The following provides the running result of the HdfsMain Linux sample application in the security cluster:
      [root@node-master1dekG client]# hadoop jar hdfs-examples-1.0.jar com.huawei.bigdata.hdfs.examples.HdfsMain
      WARNING: Use "yarn jar" to launch YARN applications.
      20/03/25 16:29:45 INFO security.UserGroupInformation: Login successful for user hdfsuser using keytab file user.keytab
      20/03/25 16:29:45 INFO security.LoginUtil: Login success!!!!!!!!!!!!!!
      success to create path /user/hdfs-examples
      success to write.
      result is : hi, I am bigdata. It is successful if you can see me.
      success to read.
      success to delete the file /user/hdfs-examples/test.txt
      success to delete path /user/hdfs-examples
      success to create path /user/hdfs-examples
      StoragePolicy:FROZEN
      StoragePolicy:COLD
      StoragePolicy:WARM
      StoragePolicy:HOT
      StoragePolicy:ONE_SSD
      StoragePolicy:ALL_SSD
      StoragePolicy:LAZY_PERSIST
      succee to set Storage Policy path /user/hdfs-examples
      success to delete path /user/hdfs-examples
    • The following provides the running result of the HdfsMain Linux sample application in the normal cluster:
      [root@node-master2VknR client]# hadoop jar hdfs-examples-1.0.jar com.huawei.bigdata.hdfs.examples.HdfsMain
      WARNING: Use "yarn jar" to launch YARN applications.
      success to create path /user/hdfs-examplessuccess to write.
      result is : hi, I am bigdata. It is successful if you can see me.
      success to read.
      success to delete the file /user/hdfs-examples/test.txt
      success to delete path /user/hdfs-example
      ssuccess to create path /user/hdfs-examples
      StoragePolicy:FROZEN
      StoragePolicy:COLD
      StoragePolicy:WARM
      StoragePolicy:HOT
      StoragePolicy:ONE_SSD
      StoragePolicy:ALL_SSD
      StoragePolicy:LAZY_PERSIST
      succee to set Storage Policy path /user/hdfs-examples
      success to delete path /user/hdfs-examples
  2. Viewing HDFS logs to learn application running status

    View HDFS namenode logs to learn application running status, and adjust applications based on log information.