Help Center/ MapReduce Service/ Component Operation Guide (LTS)/ Using Flink/ Managing FlinkServer Jobs/ Configuring Automatic Clearing of FlinkServer Job Residuals
Updated on 2024-10-09 GMT+08:00

Configuring Automatic Clearing of FlinkServer Job Residuals

Scenario

If a Flink task stops unexpectedly, some directories may reside in the ZooKeeper and HDFS services. To delete the residual directories, set ClearUpEnabled to true.

Procedure

  1. Log in to Manager.
  2. Choose Cluster > Services > Flink. On the displayed page, click the Configurations tab and then All Configurations, search for parameter ClearUpEnabled, and set it to true. For details about related parameters, see Table 1.

    Table 1 Parameters for deleting the residual directories

    Parameter

    Description

    Default Value

    Value Range

    ClearUpEnabled

    Specifies whether to delete the residual directories. Set this parameter to true if residual directories need to be deleted; set it to false otherwise.

    true

    true and false

    ClearUpPeriod

    Specifies the period for deleting residual directories, in minutes.

    1440

    1440~2147483647

    TrashDirectoryRetentionPeriod

    Specifies the period for retaining residual directories, in minutes.

    10080

    10080~2147483647

  3. Click Save.

    • This function deletes only the residual directories in the /flink_base directory of the ZooKeeper service and the /flink/recovery directory of the HDFS service. User-defined directories will not be deleted.
    • This function does not delete the checkpoints directory of the HDFS service. You need to manually delete it.