Configuring the Number of Lost Executors Displayed in WebUI
Scenario
In Spark WebUI, the Executor page can display information about Lost Executor. Executors are dynamically recycled. If the JDBCServer tasks are large, there may be too many lost executors displayed in WebUI. Therefore, the number of displayed lost executors can be configured.
Procedure
Configure the following parameter in the spark-defaults.conf file on Spark client.
| Parameter | Description | Default Value |
|---|---|---|
| spark.ui.retainedDeadExecutors | The maximum number of Lost Executors displayed in Spark WebUI. | 100 |
Last Article: Configuring the Compression Format of a Parquet Table
Next Article: Setting the Log Level Dynamically
Did this article solve your problem?
Thank you for your score!Your feedback would help us improve the website.