Checking the Commissioning Result

Scenario

After an HDFS application is run, you can learn the application running conditions by viewing the running result or HDFS logs.

Procedure

• Learn the application running conditions by viewing the running result.
  • The running result of the HDFS example application is shown as follows:

    [root@192-168-32-144 client]#hadoop jar HDFSTest-XXX.jar com.huawei.bigdata.hdfs.examples.HdfsExample
    WARNING: Use "yarn jar" to launch YARN applications.
    17/10/26 19:11:44 INFO examples.HdfsExample: success to create path /user/hdfs-examples
    17/10/26 19:11:44 INFO examples.HdfsExample: success to write.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to append.
    17/10/26 19:11:45 INFO examples.HdfsExample: result is : hi, I am bigdata. It is successful if you can see me.I append this content.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to read.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to delete the file /user/hdfs-examples/test.txt
    17/10/26 19:11:45 INFO examples.HdfsExample: success to delete path /user/hdfs-examples
    17/10/26 19:11:45 INFO examples.HdfsExample: success to create path /user/hdfs-examples/hdfs_example_1
    17/10/26 19:11:45 INFO examples.HdfsExample: success to create path /user/hdfs-examples/hdfs_example_0
    17/10/26 19:11:45 INFO examples.HdfsExample: success to write.
    17/10/26 19:11:45 INFO examples.HdfsExample: success to write.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to append.
    17/10/26 19:11:46 INFO examples.HdfsExample: result is : hi, I am bigdata. It is successful if you can see me.I append this content.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to read.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete the file /user/hdfs-examples/hdfs_example_1/test.txt
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete path /user/hdfs-examples/hdfs_example_1
    17/10/26 19:11:46 INFO examples.HdfsExample: success to append.
    17/10/26 19:11:46 INFO examples.HdfsExample: result is : hi, I am bigdata. It is successful if you can see me.I append this content.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to read.
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete the file /user/hdfs-examples/hdfs_example_0/test.txt
    17/10/26 19:11:46 INFO examples.HdfsExample: success to delete path /user/hdfs-examples/hdfs_example_0

  • The running result of the Colocation example application is shown as follows:

    [root@192-168-32-144 client]#hadoop jar HDFSTest-XXX.jar com.huawei.bigdata.hdfs.examples.ColocationExample
    WARNING: Use "yarn jar" to launch YARN applications.
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=V100R002C30, built on 10/19/2017 04:21 GMT
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:host.name=192-168-32-144
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_144
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
    17/10/26 19:12:38 INFO zookeeper.ZooKeeper: Client environment:java.home=/opt/client/JDK/jdk1.8.0_144/jre
    ......
    Create Group has finished.
    Put file is running...
    Put file has finished.
    Delete file is running...
    Delete file has finished.
    Delete Group is running...
    Delete Group has finished.
    17/10/26 19:12:39 INFO zookeeper.ZooKeeper: Session: 0x13000074b7e4687f closed
    17/10/26 19:12:39 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x13000074b7e4687f
    17/10/26 19:12:39 INFO zookeeper.ZooKeeper: Session: 0x12000059699f69e1 closed
    17/10/26 19:12:39 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x12000059699f69e1

• Learn the application running conditions by viewing HDFS logs.

  The NameNode logs of HDFS offer immediate visibility into application running conditions. You can adjust application programs based on the logs.