Viewing MRS Cluster Resource Monitoring Metrics
During MRS cluster O&M, administrators must monitor resource usage and cluster health in real time to quickly detect issues like high CPU usage, insufficient memory, and disk space alarms. The MRS resource monitoring feature categorizes cluster nodes by their deployed roles into management, control, and data nodes. It calculates change trends for key monitoring metrics on each node type and displays them in distribution curve charts. On the MRS console or MRS Manager, administrators can view cluster-level, component-level, and node-level metrics to track overall resource details. This section describes how to view MRS cluster resource monitoring metrics.
You can view the overall resource usage of a cluster on the MRS console or MRS Manager. The monitoring metrics of clusters, components, and nodes are supported. For details about how to view the metrics of components and nodes, see Viewing MRS Cluster Component Monitoring Metrics and Viewing MRS Node Resource Monitoring Metrics.
- Monitoring metric: Running status data for each node and service in an MRS cluster, including key metrics such as CPU, memory, and disk usage, as well as network traffic. Based on the collection interval, monitoring metrics are classified into real-time metrics (30s/60s) and periodic metrics (5 min).
- Resource distribution: A curve formed by the highest, lowest, or average values of key monitoring metrics for hosts and services. It shows resource distribution across nodes or services.
MRS cluster metrics are monitored periodically. The average historical monitoring interval is approximately 5 minutes. The interval on the horizontal axis varies based on your specified time period. For details, see the monitoring data retention policy for your MRS version.
Viewing Monitoring Information on the MRS Management Console
- Log in to the MRS console.
- On the Active Clusters page, select a running target cluster and click its name to go to the cluster details page.
- On the Dashboard tab, click Synchronize next to IAM User Sync to synchronize IAM users.
- After the synchronization is complete, you can view the cluster monitoring metric report on the right of the page.
- In time range area, specify a period to view monitoring data.
- Customize a monitoring report.
- Click Customize and select monitoring metrics to display.
- Click OK to save the selected monitoring metrics for display.
- Click Deselect All to deselect all metrics.
- Export a monitoring report. Monitoring metric reports can be exported only for versions earlier than MRS 3.x.
- Select a period.
- Click Export. MRS will generate a report about the selected monitoring metrics in a specified time range. Save the report.
Verification:
On the monitoring information page, check whether the metric report displays the monitoring data curve for your selected time range. If the chart data loads properly and displays the metrics you selected, the verification is successful.
Viewing Monitoring Information on Manager (MRS 3.x and Later)
- Log in to FusionInsight Manager of the MRS cluster.
For details about how to log in to FusionInsight Manager, see Accessing MRS Manager.
- Choose Homepage.
- In the upper right corner of the chart area, click
and choose Customize from the displayed menu.
Monitoring data of the past 1 hour is displayed at an interval of 5 minutes. After you enter the Real-time Monitoring page, you can view that real-time monitoring data is displayed on the right of the monitoring chart at an interval of 5 minutes.
- In the navigation pane, select an entity and some monitoring metrics.
- Click OK to view the metric details.
- Export a monitoring report.
- Exporting all monitoring data
- On the Homepage, select a time range in the upper right corner of the chart area, for example, 1w.
Real-time data is displayed by default, which cannot be exported. You can click
to customize a time range. - In the upper right corner of the chart area, click
and choose Export from the displayed menu.
- On the Homepage, select a time range in the upper right corner of the chart area, for example, 1w.
- Exporting monitoring data of a specified monitoring item
- On the Homepage, click
in the upper right corner of any monitoring report pane in the chart area of the target cluster. - Select a time range to obtain monitoring data, for example, 1w.
Real-time data is displayed by default, which cannot be exported. You can click
to customize a time range. - Click Export.
- On the Homepage, click
The interval on the horizontal axis of the chart varies depending on the time period you specify. Data monitoring rules are as follows:
- If the disk usage of the partition where GaussDB is deployed exceeds 80%, real-time monitoring data and monitoring data whose interval is 5 minutes will be deleted.
- Storage resources (HDFS) in Tenant Resources (0 to 300 hours): The interval is 1 hour. The cluster must have been installed for at least 1 hour, and monitoring data of a maximum of 3 months is saved.
For clusters of versions earlier than MRS 3.3.0:
- 0 to 25 hours: The interval is 5 minutes. The cluster must have been installed for at least 10 minutes, and monitoring data of a maximum of 15 days is saved.
- 25 to 150 hours: The interval is 30 minutes. The cluster must have been installed for at least 30 minutes, and monitoring data of a maximum of 3 months is saved.
- 150 to 300 hours: The interval is 1 hour. The cluster must have been installed for at least 1 hour, and monitoring data of a maximum of 3 months is saved.
- 300 hours to 300 days: The interval is 1 day. The cluster must have been installed for at least 1 day, and monitoring data of a maximum of 6 months is saved.
- Over 300 days: The interval is 7 days. The cluster must have been installed for more than 7 days, and monitoring data of a maximum of 1 year is saved.
For clusters of MRS 3.3.0 and later versions:
- 0 to 21 hours and 20 minutes: The interval is 5 minutes. The cluster must have been installed for at least 10 minutes, and monitoring data of a maximum of 90 days is saved.
- 21 hours and 20 minutes to 128 hours: The interval is 30 minutes. The cluster must have been installed for at least 30 minutes, and monitoring data of a maximum of 90 days is saved.
- 128 to 256 hours: The interval is 1 hour. The cluster must have been installed for at least 1 hour, and monitoring data of a maximum of 90 days is saved.
- 256 hours to 256 days: The interval is 1 day. The cluster must have been installed for at least 1 day, and monitoring data of a maximum of 90 days is saved.
- Exporting all monitoring data
Verification:
On the homepage, check whether the data curve chart appears correctly in the report for your selected metric. If the chart data loads properly and the exported report file is not empty, the view and export operations are successful.
Viewing Monitoring Information on Manager (MRS 2.x and Earlier)
- Log in to FusionInsight Manager of the MRS cluster.
For details about how to log in to FusionInsight Manager, see Accessing MRS Manager.
- Choose System on MRS Manager.
- In Period, you can specify a period to view monitoring data. The options are as follows:
Real-time, last 3 hours, last 6 hours, last 24 hours, last 1 week, last 1 month, last 3 months, last 6 months, and custom time range
- Click View to view monitoring data in a specified period.
- You can view Health Status and Roles of each service on the Service Summary page of MRS Manager.
- Click
above the curve chart to view details about a metric.
- Customize a monitoring report.
Click Customize and select monitoring metrics to be displayed on MRS Manager. Click OK to save the selected monitoring metrics for display. Click Clear to cancel all the selected monitoring metrics in a batch.
MRS Manager supports a maximum of 14 monitoring metrics, but at most 12 customized monitoring metrics can be displayed on the page.
- Set an automatic refresh interval or click
for an immediate refresh. If you select Full Screen, the Dashboard window will be maximized. The following refresh interval options are supported:
- Refresh every 60 seconds
- Refresh every 120 seconds
- Stop refreshing
- Export a monitoring report.
Select a period. Click Export. MRS Manager will generate a report for the selected monitoring metrics over a specified period. Select a directory to save the report.
To view the curve charts of monitoring metrics in a specified period, click View.
On MRS Manager, you can query the top, bottom, and average value curves of key service and host monitoring metrics, that is, the resource distribution information. MRS Manager allows you to view the monitoring data of the last hour.
You can also modify the resource distribution on MRS Manager to display both the top and bottom value curves in service and host resource distribution figures.
Resource distribution of some monitoring metrics is not recorded.
- View the resource distribution of service monitoring metrics.
- On MRS Manager page, click Services.
- Select the target service from the service list.
- Click Resource Distribution.
Select key metrics of the service from Metric. MRS Manager displays the resource distribution of the metrics in the last hour.
- View the resource distribution of host monitoring metrics.
- On MRS Manager, click Hosts.
- Click the name of the specified host in the host list.
- Click Resource Distribution.
Select key metrics of the host from Metrics. MRS Manager displays the resource distribution of the metrics in the last hour.
- Configure resource distribution.
- On MRS Manager, click System.
- In Configuration, click Configure Resource Contribution Ranking under Monitoring and Alarm.
- Change the number of resources to be displayed. The sum of the maximum value and minimum value of resource distribution cannot be greater than 5.
Set Number of Top Resources to the number of top values.
Set Number of Bottom Resources to the number of bottom values.
- Click OK to save the configurations.
- View the resource distribution of service monitoring metrics.
FAQs
- Q: What should I do if monitoring data is missing or incomplete?
Common causes: The cluster was recently created and insufficient monitoring data has been collected so far. Disk usage on the partition hosting the MRS Manager database exceeds 80%, causing real-time and 5-minute monitoring data to be cleared. The selected time range falls outside the data retention period.
Ensure that the cluster has been running for at least 10 minutes and check the disk usage. If disk space is insufficient, delete unnecessary files to free up space. Select a shorter time range and view the monitoring data again.
- Q: What should I do if exporting a monitoring report fails?
The export might fail if real-time data is selected (real-time data cannot be exported by default) or if your browser blocks the file download request.
Click the time range selection icon to select a non-real-time range and try exporting again. Check whether your browser blocked the download request. If so, allow downloads and try again.
Helpful Links
- For details about how to view MRS cluster component monitoring metrics, see Viewing MRS Cluster Component Monitoring Metrics.
- For details about how to view MRS cluster node monitoring metrics, see Viewing MRS Node Resource Monitoring Metrics.
- For details about how to configure MRS cluster alarm thresholds, see Configuring Alarm Thresholds for an MRS Cluster.