Resource Monitoring
Log in to FusionInsight Manager and choose Cluster > Services > Target service. Click Resource. The resource monitoring page is displayed.
Some services in the cluster provide service-level resource monitoring metrics. By default, the monitoring data of the latest 12 hours is displayed. You can click to customize a time range. Time range options are 12h, 1d, 1w, and 1m. You can click to export the corresponding report information. If a monitoring item has no data, the report cannot be exported. Table 1 lists the services and monitoring items that support resource monitoring.
Service |
Metrics |
Description |
---|---|---|
ClickHouse |
Part Information |
Top 10 tables with the largest number of parts on each ClickHouse node |
Elasticsearch |
Thread Pool Information |
Displays information about the thread pool in an Elasticsearch cluster. |
Index Information |
Displays the information about each index in an Elasticsearch cluster. |
|
User Resource Information |
Displays the total number of indexes created by each user in the Elasticsearch cluster, total number of index shards, total number of index documents, and total index storage capacity. |
|
Index Data Volume |
Displays the number of documents and storage data volume of each index in an Elasticsearch cluster. |
|
HDFS |
Resource Usage (by Tenant) |
|
Resource Usage (by User) |
|
|
Resource Usage (by Directory) |
|
|
Resource Usage (by Replica) |
|
|
Resource Usage (by File Size) |
|
|
Recycle Bin (by User) |
|
|
Operation Count |
|
|
Automatic Balancer |
|
|
NameNode RPC Open Connections (by User) |
|
|
Slow DataNodes |
Displays DataNode that transmits or processes data slowly in the cluster. |
|
Slow Disks |
Displays the disk that processes data slowly on the DataNode in the cluster. |
|
HBase |
Operation Requests in Tables |
Displays the number of PUT, DELETE, GET, SCAN, INCREMENT, and APPEND operation requests in all tables on all RegionServers. |
Operation Requests on RegionServers |
Displays the number of PUT, DELETE, GET, SCAN, INCREMENT, and APPEND operation requests and number of all operation requests in RegionServer. |
|
Operation Requests for Service |
Displays the number of PUT, DELETE, GET, SCAN, INCREMENT, and APPEND operation requests in all regions on RegionServers. |
|
HFiles on RegionServers |
Displays the number of HFiles in all RegionServers. |
|
HetuEngine |
Coordinator Resource Usage |
Displays the coordinator resource usage in the selected queue. |
Coordinator Resource Usage Ratio |
Displays the coordinator resource usage in the selected queue. |
|
Worker Resource Usage |
Displays the worker resource usage in the selected queue. |
|
Worker Resource Usage Ratio |
Displays the worker resource usage in the selected queue. |
|
Number of Coordinators and Workers |
Displays the number of coordinators and workers in the selected queue. |
|
Hive |
HiveServer2-Background-Pool Threads (by IP) |
Displays the number of HiveServer2-Background-Pool threads of top users. These threads are measured and displayed in a measurement period. |
HiveServer2-Handler-Pool Threads (by IP) |
Displays the number of HiveServer2-Handler-Pools of top users collected and displayed in a period. |
|
Used MetaStore Number (by IP) |
Collects statistics on and displays the MetaStore usage of top users in a period. |
|
Number of Hive jobs |
Displays the number of user-related jobs collected by Hive in a period. |
|
Number of Files Accessed in the Split Phase |
Displays the number of files accessed by the underlying file storage system (HDFS by default) in the Split phase in a period. |
|
Hive Basic Operation Time |
Collects time for creating a directory (mkdirTime), creating a file (touchTime), writing a file (writeFileTime), renaming a file (renameTime), moving a file (moveTime), deleting a file (deleteFileTime), and deleting a directory (deleteCatalogTime) in a period of time. |
|
Table Partitions |
Displays the number of partitions in all Hive tables, which is displayed in the following format: database # table name, number of table partitions. |
|
HQL Map Count |
Collects statistics on HQL statements executed in a period and the number of Map statements invoked during the execution. The displayed information includes users, HQL statements, and the number of Map statements. |
|
HQL Access Statistics |
Displays the number of HQL access times in a period. |
|
Kafka |
Kafka Disk Usage Distribution |
Displays the disk usage distribution statistics of the Kafka cluster. |
Spark |
HQL Access Statistics |
Collects HQL access statistics in a period, including the username, HQL statement, and HQL statement execution times. |
Yarn |
Used resources (by task) |
|
Resource usage (by tenant) |
|
|
Resource usage ratio (by tenant) |
|
|
Task Duration Ranking |
Displays Yarn tasks sorted by time consumption. |
|
ResourceManager RPC Open Connections (by User) |
Displays the number of client RPC connections to ResourceManager by user. |
|
Operation Count |
Collects statistics on the number and proportion of operations corresponding to each Yarn operation type. |
|
Ranking of Tasks in a Queue by Resource Usage |
|
|
Ranking of Users in a Queue by Resource Usage |
|
|
ZooKeeper |
Used Resources (By Second-Level Znode) |
|
Number of Connections (by Client IP Address) |
Displays the ZooKeeper client connection resource status. |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot