Multi-Tenancy Alarms

Updated on 2024-12-13 GMT+08:00

View PDF

Doris multi-tenancy is built on top of the Workload Group Resource soft limit of the kernel. Workload groups only restrict the compute and memory resources used by tasks in a group on a single BE node. There is no resource pool for tenants. When query tasks are executed, resources are dynamically allocated to each BE node.

Doris multi-tenancy alarms are reported for nodes. The monitoring metric data can be aggregated by service or tenant.

Multi-Tenancy Monitoring

Tenant monitoring
On the FusionInsight Manager homepage, click Tenant Resources. In the tenant list, click the name of a Doris tenant. In the Summary tab, you can view monitoring information of the tenant in the Resource Quota and Chart areas.
- CPU: average CPU usage of all BE nodes used by the tenant
- Memory: average memory usage of all BE nodes used by the tenant
- Concurrency: total number of concurrent queries on all FE nodes used by the tenant
NOTE:
- Resource quota is not refreshed in real time. The resource usage is queried only when you go to the Summary tab. The monitoring is in real time but monitoring data is refreshed every 30 seconds.
- The Average Tenant CPU Usage Ratio chart shows the average percentage of the time when the query tasks of the tenant occupy the CPU resources of all BE nodes.
- The number of FEs is not counted when jobs are queued. Therefore, the number of concurrent queries set by a tenant takes effect only on FE nodes. TheTotal Number of Concurrent Tenant Queries chart indicates the overall number of concurrent queries of a tenant.
Service monitoring
On the FusionInsight Manager homepage, choose Cluster > Services > Doris and click Chart. In Chart Category, select Tenant Resource to view the resource usage of all Doris tenants.
Instance monitoring
On the FusionInsight Manager homepage, choose Cluster > Services > Doris and click Instances, click the FE or BE instance of the desired tenant. In the Chart tab, select Tenant Resource from Chart Category. You can view the node resources used by all tenants.

Figure 1 FE instance resource monitoring

Figure 2 BE instance resource monitoring

Multi-Tenancy Alarms

Doris multi-tenancy alarms include:

Number of concurrent requests (alarm ID: 50227): The alarm is generated when the number of concurrent tenant requests on an FE node exceeds the threshold (90% by default).
Memory usage (alarm ID: 50228): The alarm is generated when the memory usage of a BE node exceeds the threshold (90% for critical alarms and 85% for major alarms).

NOTE:

The memory usage alarm is generated only for tenants who disabled soft memory soft limit.
On FusionInsight Manager, choose O&M > Alarm > Alarms, click on the left of an alarm name, and determine the role and node for which the alarm is generated in the Location field. To identify the tenant for which the alarm is generated, view the monitoring chart on the FE or BE node for which the alarm is generated.

Parent topic: Configuring Doris Multi-Tenancy

Previous topic: Managing Doris Tenants

Next topic: Doris Cold and Hot Data Separation

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot