Configuring the Number of Lost Executors Displayed on the Web UI
Scenarios
On the Spark web UI, the Executor page can display information about lost executors. Executors of JDBCServer long tasks are dynamically recycled. Therefore, the number of displayed lost executors must be configured to fit the Executor page.
Configuration Description
Configure the following parameters in the spark-defaults.conf file of the Spark client.
Parameter |
Description |
Default Value |
---|---|---|
spark.ui.retainedDeadExecutors |
Specifies the maximum number of lost executors displayed on the Spark web UI. |
100 |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot