Updated on 2024-11-29 GMT+08:00

Query Performance Deterioration

Symptom

The query performance fluctuates when the query is executed in different query periods.

Possible Causes

During data loading, the memory configured for each executor program instance may be insufficient, resulting in more Java GCs. When GC occurs, the query performance deteriorates.

Troubleshooting Method

On the Spark UI, the GC time of some executors is obviously higher than that of other executors, or all executors have high GC time.

Procedure

Log in to FusionInsight Manager and choose Cluster > Services > Spark. Click Configurations then All Configurations, search for spark.executor.memory in the search box, and set it to a larger value.

Reference

None