Help Center/ MapReduce Service/ User Guide (Ankara Region)/ Alarm Reference/ ALM-16048 Tez or Spark Library Path Does Not Exist
Updated on 2024-11-29 GMT+08:00

ALM-16048 Tez or Spark Library Path Does Not Exist

Alarm Description

The system checks the Tez and Spark library paths every 180 seconds. This alarm is generated when the Tez or Spark library path does not exist.

Alarm Attributes

Alarm ID

Alarm Severity

Alarm Type

Service Type

Auto Cleared

16048

Major

Quality of service

Hive

Yes

Alarm Parameters

Type

Parameter

Description

Location Information

Source

Specifies the cluster for which the alarm is generated.

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

Impact on the System

The Hive on Tez and Hive on Spark functions are affected.

Possible Causes

The Tez or Spark library path is deleted from the HDFS.

Handling Procedure

Check the default Hive data warehouse.

  1. Log in to the node where the client is located as user root.
  2. Run the following command to check whether the tezlib or sparklib directory exists in the hdfs://hacluster/user/{User name}/.Trash/Current/ director:

    hdfs dfs -ls hdfs://hacluster/user/<username>/.Trash/Current/

    For example, the following information shows that /user/hive/tezlib/8.1.0.1/ and /user/hive/sparklib/8.1.0.1/ exist.

    host01:/opt/client # hdfs dfs -ls hdfs://hacluster/user/test/.Trash/Current/ 
    Found 1 items 
    drwx------   - test hadoop          0 2019-06-17 19:53 hdfs://hacluster/user/test/.Trash/Current/user
    • If yes, go to 3.
    • If no, go to 5.

  3. Run the following command to restore tezlib and sparklib.

    hdfs dfs -mv hdfs://hacluster/user/<username>/.Trash/Current/user/hive/tezlib/8.1.0.1/tez.tar.gz /user/hive/tezlib/8.1.0.1/tez.tar.gz

  4. Check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to 5.

Collect fault information.

  1. Collect related information in the .Trash/Current/ directory on the client background.
  2. Contact the O&M engineers and send the collected logs.

Alarm Clearance

After the fault is rectified, the system automatically clears this alarm.

Related Information

None.