更新时间:2024-08-03 GMT+08:00

查看HDFS应用调测结果

操作场景

HDFS应用程序运行完成后,可直接通过运行结果查看应用程序运行情况,也可以通过HDFS日志获取应用运行情况。

操作步骤

  1. 查看运行结果获取应用运行情况
    • HdfsMain Linux样例程序安全集群运行结果如下所示:
      [root@node-master1dekG client]# hadoop jar hdfs-examples-1.0.jar com.huawei.bigdata.hdfs.examples.HdfsMain
      WARNING: Use "yarn jar" to launch YARN applications.
      20/03/25 16:29:45 INFO security.UserGroupInformation: Login successful for user hdfsuser using keytab file user.keytab
      20/03/25 16:29:45 INFO security.LoginUtil: Login success!!!!!!!!!!!!!!
      success to create path /user/hdfs-examples
      success to write.
      result is : hi, I am bigdata. It is successful if you can see me.
      success to read.
      success to delete the file /user/hdfs-examples/test.txt
      success to delete path /user/hdfs-examples
      success to create path /user/hdfs-examples
      StoragePolicy:FROZEN
      StoragePolicy:COLD
      StoragePolicy:WARM
      StoragePolicy:HOT
      StoragePolicy:ONE_SSD
      StoragePolicy:ALL_SSD
      StoragePolicy:LAZY_PERSIST
      succee to set Storage Policy path /user/hdfs-examples
      success to delete path /user/hdfs-examples
    • HdfsMain Linux样例程序普通集群运行结果如下所示:
      [root@node-master2VknR client]# hadoop jar hdfs-examples-1.0.jar com.huawei.bigdata.hdfs.examples.HdfsMain
      WARNING: Use "yarn jar" to launch YARN applications.
      success to create path /user/hdfs-examplessuccess to write.
      result is : hi, I am bigdata. It is successful if you can see me.
      success to read.
      success to delete the file /user/hdfs-examples/test.txt
      success to delete path /user/hdfs-example
      ssuccess to create path /user/hdfs-examples
      StoragePolicy:FROZEN
      StoragePolicy:COLD
      StoragePolicy:WARM
      StoragePolicy:HOT
      StoragePolicy:ONE_SSD
      StoragePolicy:ALL_SSD
      StoragePolicy:LAZY_PERSIST
      succee to set Storage Policy path /user/hdfs-examples
      success to delete path /user/hdfs-examples
  2. 查看HDFS日志获取应用运行情况

    您可以查看HDFS的namenode日志了解应用运行情况,并根据日志信息调整应用程序。