Query Performance Deteriorated Due to Insufficient Executor Memory
Symptom
The query performance fluctuates when the query is executed in different query periods.
Possible Causes
During data loading, the memory configured for each executor program instance may be insufficient, resulting in more Java GCs. When GC occurs, the query performance deteriorates.
Troubleshooting Method
On the Spark UI, the GC time of some executors is obviously higher than that of other executors, or all executors have high GC time.
Procedure
Log in to Manager and choose Cluster > Services > Spark2x. On the displayed page, click the Configurations tab and then All Configurations, search for spark.executor.memory in the search box, and set its value to a larger value.
Reference
None
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
