ALM-18006 MapReduce Job Execution Timeout (For MRS 2.x or Earlier)

Description

The alarm module checks the MapReduce job execution every 30 seconds. This alarm is generated when the execution of a submitted MapReduce job times out.

This alarm must be manually cleared.

Attribute

Parameters

Impact on the System

Execution of the submitted MapReduce job times out, so no execution result can be obtained. Execute the job again after rectifying the fault.

Possible Causes

It takes a long time to execute a MapReduce job. However, the specified time is less than the required execution time.

Procedure

1. Check whether time is improperly set.
   Set -Dapplication.timeout.interval to a larger value, or do not set the parameter. Check whether the MapReduce job can be executed.

   • If yes, go to 2.e.
   • If no, go to 2.b.

2. Check the Yarn status.
   1. Go to the cluster details page and choose Alarms.
   2. In the alarm list on MRS Manager, check whether the alarm ALM-18000 Yarn Service Unavailable is generated.
      • If yes, go to 2.c.
      • If no, go to 3.
   3. Rectify the fault by following the handling procedure in ALM-18000 Yarn Service Unavailable (For MRS 2.x or Earlier).
   4. Run the MapReduce job command again to check whether the MapReduce job can be executed.
      • If yes, go to 2.e.
      • If no, go to 4.
   5. In the alarm list, click in the Operation column of the alarm to manually clear the alarm. No further action is required.

3. Adjust the timeout threshold.
   On MRS Manager, choose System > Threshold Configuration > Services > Yarn > Timed out Applications, and increase the maximum number of timeout tasks allowed by the current threshold rule. Check whether the alarm is cleared.

   • If yes, no further action is required.
   • If no, go to 4.

4. Collect fault information.
   1. On MRS Manager, choose System > Export Log.
   2. Contact the O&M engineers and send the collected logs.

Reference

None