ALM-16048 Tez or Spark Library Path Does Not Exist

Description

The system checks the Tez and Spark library paths every 180 seconds. This alarm is generated when the Tez or Spark library path does not exist.

Attribute

Parameters

Impact on the System

The Hive on Tez and Hive on Spark functions are affected.

Possible Causes

The Tez or Spark library path is deleted from the HDFS.

Procedure

Check the default Hive data warehouse.

1. Log in to the node where the client is located as user root.
2. Run the following command to check whether the tezlib or sparklib directory exists in the hdfs://hacluster/user/{User name}/.Trash/Current/ director:

   hdfs dfs -ls hdfs://hacluster/user/<username>/.Trash/Current/

   For example, the following information shows that /user/hive/tezlib/8.1.0.1/ and /user/hive/sparklib/8.1.0.1/ exist.

   host01:/opt/client # hdfs dfs -ls hdfs://hacluster/user/test/.Trash/Current/ 
   Found 1 items 
   drwx------   - test hadoop          0 2019-06-17 19:53 hdfs://hacluster/user/test/.Trash/Current/user

   • If yes, go to 3.
   • If no, go to 5.

3. Run the following command to restore tezlib and sparklib.

   hdfs dfs -mv hdfs://hacluster/user/<username>/.Trash/Current/user/hive/tezlib/8.1.0.1/tez.tar.gz /user/hive/tezlib/8.1.0.1/tez.tar.gz

4. Check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to 5.

   Collect fault information.

5. Collect related information in the .Trash/Current/ directory on the client background.
6. Contact the O&M personnel and send the collected logs.

Alarm Clearing

After the fault is rectified, the system automatically clears this alarm.

Related Information

None