Help Center/ MapReduce Service/ User Guide/ MRS Cluster O&M/ MRS Cluster Alarm Handling Reference/ ALM-47003 Memory Usage of the MemArtsCC Worker Process Exceeds the Threshold
Updated on 2024-11-13 GMT+08:00
View PDF
Share

ALM-47003 Memory Usage of the MemArtsCC Worker Process Exceeds the Threshold

This section is available for MRS 3.5.0 or later version only.

Alarm Description

The system checks the memory usage of the CCWorker process of the MemArtsCC component every 30 seconds. This alarm is generated when the memory usage exceeds the threshold.

This alarm is cleared when the system detects that the memory usage of CCWorker process is lower than the threshold.

Alarm Attributes

Alarm ID

Alarm Severity

Auto Cleared

47003

Major

Yes

Alarm Parameters

Type

Parameter

Description

Location Information

Source

Specifies the cluster or system for which the alarm is generated.

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

Impact on the System

The CCWorker process process may restart, which temporarily reduces the cache hit ratio.

Possible Causes

There is more disk space added to CCWorker, there is a sudden increase in service data, or the workload increases significantly when upper-layer computing services (such as Spark, Hive, and HetuEngine) sent many concurrent requests to the MemArtsCC component.

Handling Procedure

  1. Log in to FusionInsight Manager, choose O&M > Alarm > Alarms, search for ALM-47003 Memory Usage of the MemArtsCC Worker Process Exceeds the Threshold, and locate the abnormal MemArtsCC instance node based on the alarm information. Obtain the alarm threshold in additional information.
  2. Choose Cluster > Services > MemArtsCC > Configurations > All Configurations > CCWorker (Role), search for the memory_limit parameter, and check the maximum available memory of the CCWorker instance in the current cluster. Check whether the service concurrency and data volume increase for a long time and the alarm is not automatically cleared.

    • If yes, go to 4.
    • If no, go to 3.

  3. This alarm can be ignored temporarily. After the service peak hours, the alarm will be automatically cleared.
  4. Increase the maximum available memory in 2 and click Save.
  5. Choose O&M > Alarm > Alarms and check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to 6.

Collect fault information.

  1. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
  2. Expand the Service drop-down list, and select MemArtsCC for the target cluster.
  3. Click the edit icon in the upper right corner, and set Start Date and End Date for log collection to 10 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
  4. Contact O&M personnel and send the collected logs.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None