ALM-16048 Tez or Spark Library Path Does Not Exist

Description

The system checks the Tez and Spark library paths every 180 seconds. This alarm is generated when the Tez or Spark library path does not exist.

Attribute

Parameters

Impact on the System

The Hive on Tez and Hive on Spark functions are affected.

Possible Causes

The Tez or Spark library path is deleted from the HDFS.

Procedure

Check the Tez and Spark library paths.

1. Log in to the node where the client is deployed as user root.

2. Run the following command to check whether the tezlib or sparklib directory exists in the hdfs://hacluster/user/{User name}/.Trash/Current/ director:

   hdfs dfs -ls hdfs://hacluster/user/<username>/.Trash/Current/

   For example, the following information shows that /user/hive/tezlib/8.1.0.1/ and /user/hive/sparklib/8.1.0.1/ exist.

   host01:/opt/client # hdfs dfs -ls hdfs://hacluster/user/test/.Trash/Current/
   Found 1 items
   drwx------   - test hadoop          0 2019-06-17 19:53 hdfs://hacluster/user/test/.Trash/Current/user

   • If yes, go to Step 3.
   • If no, go to Step 5.

3. Run the following command to restore tezlib and sparklib.

   hdfs dfs -mv hdfs://hacluster/user/<username>/.Trash/Current/user/hive/tezlib/8.1.0.1/tez.tar.gz /user/hive/tezlib/8.1.0.1/tez.tar.gz

4. Check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to Step 5.

Collect fault information.

5. Collect related information in the .Trash/Current/ directory on the client background.
6. Contact the O&M personnel and send the collected logs.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None