查看调测结果

操作场景

HDFS应用程序运行完成后，可直接通过运行结果查看应用程序运行情况，也可以通过HDFS日志获取应用运行情况。

操作步骤

• 查看运行结果获取应用运行情况
  • HdfsExample Linux样例程序运行结果如下所示。

    [root@192-168-32-144 client]#hadoop jar HDFSTest-XXX.jar com.huawei.bigdata.hdfs.examples.HdfsExample
    WARNING: Use "yarn jar" to launch YARN applications.
    17/10/26 19:11:44 INFO examples.HdfsExample: success to create path /user/hdfs-examples
    17/10/26 19:11:44 INFO examples.HdfsExample: success to write.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to append.
    17/10/26 19:11:45 INFO examples.HdfsExample: result is : hi, I am bigdata. It is successful if you can see me.I append this content.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to read.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to delete the file /user/hdfs-examples/test.txt
    17/10/26 19:11:45 INFO examples.HdfsExample: success to delete path /user/hdfs-examples
    17/10/26 19:11:45 INFO examples.HdfsExample: success to create path /user/hdfs-examples/hdfs_example_1
    17/10/26 19:11:45 INFO examples.HdfsExample: success to create path /user/hdfs-examples/hdfs_example_0
    17/10/26 19:11:45 INFO examples.HdfsExample: success to write.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to write.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to append.
    17/10/26 19:11:46 INFO examples.HdfsExample: result is : hi, I am bigdata. It is successful if you can see me.I append this content.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to read.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete the file /user/hdfs-examples/hdfs_example_1/test.txt
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete path /user/hdfs-examples/hdfs_example_1
    17/10/26 19:11:46 INFO examples.HdfsExample: success to append.
    17/10/26 19:11:46 INFO examples.HdfsExample: result is : hi, I am bigdata. It is successful if you can see me.I append this content.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to read.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete the file /user/hdfs-examples/hdfs_example_0/test.txt
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete path /user/hdfs-examples/hdfs_example_0

  • ColocationExample Linux样例程序运行结果如下所示。

    [root@192-168-32-144 client]#hadoop jar HDFSTest-XXX.jar com.huawei.bigdata.hdfs.examples.ColocationExample
    WARNING: Use "yarn jar" to launch YARN applications.
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=xxx, built on 10/19/2017 04:21 GMT
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:host.name=192-168-32-144
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_144
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:java.home=/opt/client/JDK/jdk1.8.0_144/jre
    ......
    Create Group has finished.
    Put file is running...
    Put file has finished.
    Delete file is running...
    Delete file has finished.
    Delete Group is running...
    Delete Group has finished.
    17/10/26 19:12:39 INFO zookeeper.ZooKeeper: Session: 0x13000074b7e4687f closed
    17/10/26 19:12:39 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x13000074b7e4687f
    17/10/26 19:12:39 INFO zookeeper.ZooKeeper: Session: 0x12000059699f69e1 closed
    17/10/26 19:12:39 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x12000059699f69e1

• 查看HDFS日志获取应用运行情况

可以查看HDFS的namenode日志了解应用运行情况，并根据日志信息调整应用程序。