Updated on 2024-04-11 GMT+08:00

ALM-18006 MapReduce Job Execution Timeout (For MRS 2.x or Earlier)

Description

The alarm module checks the MapReduce job execution every 30 seconds. This alarm is generated when the execution of a submitted MapReduce job times out.

This alarm must be manually cleared.

Attribute

Alarm ID

Alarm Severity

Auto Clear

18006

Major

No

Parameters

Parameter

Description

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

Trigger condition

Generates an alarm when the actual indicator value exceeds the specified threshold.

Impact on the System

Execution of the submitted MapReduce job times out, so no execution result can be obtained. Execute the job again after rectifying the fault.

Possible Causes

It takes a long time to execute a MapReduce job. However, the specified time is less than the required execution time.

Procedure

  1. Check whether time is improperly set.

    Set -Dapplication.timeout.interval to a larger value, or do not set the parameter. Check whether the MapReduce job can be executed.
    • If yes, go to 2.e.
    • If no, go to 2.b.

  2. Check the Yarn status.

    1. Go to the cluster details page and choose Alarms.
    2. In the alarm list on MRS Manager, check whether the alarm ALM-18000 Yarn Service Unavailable is generated.
      • If yes, go to 2.c.
      • If no, go to 3.
    3. Rectify the fault by following the handling procedure in ALM-18000 Yarn Service Unavailable (For MRS 2.x or Earlier).
    4. Run the MapReduce job command again to check whether the MapReduce job can be executed.
      • If yes, go to 2.e.
      • If no, go to 4.
    5. In the alarm list, click in the Operation column of the alarm to manually clear the alarm. No further action is required.

  3. Adjust the timeout threshold.

    On MRS Manager, choose System > Threshold Configuration > Services > Yarn > Timed out Applications, and increase the maximum number of timeout tasks allowed by the current threshold rule. Check whether the alarm is cleared.
    • If yes, no further action is required.
    • If no, go to 4.

  4. Collect fault information.

    1. On MRS Manager, choose System > Export Log.
    2. Contact the O&M engineers and send the collected logs.

Reference

None