Help Center/ MapReduce Service/ Component Operation Guide (LTS) (Ankara Region)/ Using Doris/ Multi-Tenancy/ Multi-Tenancy Alarms
Updated on 2024-11-29 GMT+08:00
View PDF
Share

Multi-Tenancy Alarms

Doris multi-tenancy is built on top of the Workload Group Resource soft limit of the kernel. Workload groups only restrict the compute and memory resources used by tasks in a group on a single BE node. There is no resource pool for tenants. When query tasks are executed, resources are dynamically allocated to each BE node.

Doris multi-tenancy alarms are reported for nodes. The monitoring metric data can be aggregated by service or tenant.

Multi-Tenancy Monitoring

  • Tenant monitoring

    On the FusionInsight Manager homepage, click Tenant Resources. In the tenant list, click the name of a Doris tenant. In the Summary tab, you can view monitoring information of the tenant in the Resource Quota and Chart areas.

    • CPU: average CPU usage of all BE nodes used by the tenant
    • Memory: average memory usage of all BE nodes used by the tenant
    • Concurrency: total number of concurrent queries on all FE nodes used by the tenant

    • Resource quota is not refreshed in real time. The resource usage is queried only when you go to the Summary tab. The monitoring is in real time but monitoring data is refreshed every 30 seconds.
    • The Average Tenant CPU Usage Ratio chart shows the average percentage of the time when the query tasks of the tenant occupy the CPU resources of all BE nodes.
    • The number of FEs is not counted when jobs are queued. Therefore, the number of concurrent queries set by a tenant takes effect only on FE nodes. TheTotal Number of Concurrent Tenant Queries chart indicates the overall number of concurrent queries of a tenant.
  • Service monitoring

    On the FusionInsight Manager homepage, choose Cluster > Services > Doris and click Chart. In Chart Category, select Tenant Resource to view the resource usage of all Doris tenants.

  • Instance monitoring

    On the FusionInsight Manager homepage, choose Cluster > Services > Doris and click Instances, click the FE or BE instance of the desired tenant. In the Chart tab, select Tenant Resource from Chart Category. You can view the node resources used by all tenants.

    Figure 1 FE instance resource monitoring
    Figure 2 BE instance resource monitoring

Multi-Tenancy Alarms

Doris multi-tenancy alarms include:

  • Number of concurrent requests (alarm ID: 50227): The alarm is generated when the number of concurrent tenant requests on an FE node exceeds the threshold (90% by default).
  • Memory usage (alarm ID: 50228): The alarm is generated when the memory usage of a BE node exceeds the threshold (90% for critical alarms and 85% for major alarms).
  • The memory usage alarm is generated only for tenants who disabled soft memory soft limit.
  • On FusionInsight Manager, choose O&M > Alarm > Alarms, click on the left of an alarm name, and determine the role and node for which the alarm is generated in the Location field. To identify the tenant for which the alarm is generated, view the monitoring chart on the FE or BE node for which the alarm is generated.
Parent topic: Multi-Tenancy