Updated on 2022-08-12 GMT+08:00

Clearing Unassociated Queues of a Tenant in Capacity Scheduler Mode

Scenario

In Yarn Capacity Scheduler mode, to delete a tenant, set the capacity of a tenant's queue to 0 and the state of the tenant to STOPPED to delete a tenant. However, queues of the tenant remain in the Yarn service. Queues cannot be automatically deleted due to the Yarn mechanism. The administrator can run the commands to manually delete the queues.

Impact on the System

  • Running the script will restart the controller service, synchronize Yarn configuration, and restart instances of the active and standby ResourceManagers.
  • You cannot log in to FusionInsight Manager and perform operations on FusionInsight Manager when restarting the controller service.
  • After the instances of the active and standby ResourceManagers are restarted, an alarm will be reported indicating that Yarn and components that depend on Yarn will be temporarily unavailable.

Prerequisites

  • You have logged in to FusionInsight Manager.
  • Queues of a deleted tenant still exist.

Procedure

  1. Check whether queues of the deleted tenant still exist.

    1. On FusionInsight Manager, choose Cluster > Name of the desired cluster > Services > Yarn. Click ResourceManager(Active) to go to the ResourceManager WebUI.
    2. Click Scheduler on the left pane, and you can see that queues of the tenant still exist. The state of the tenant is STOPPED and Configured Capacity is set to 0.

  2. Log in to the active OMS node as user omm.
  3. Go to the ${BIGDATA_HOME}/om-server/om/sbin directory and run the cleanQueuesAndRestartRM.sh script.

    cd ${BIGDATA_HOME}/om-server/om/sbin

    ./cleanQueuesAndRestartRM.sh -c Cluster ID

    Replace Cluster ID with the ID of the cluster to be operated, which can be queried by choosing Cluster > Name of the desired cluster > Cluster Properties on FusionInsight Manager.

    During the script execution, enter yes and the password.

    Running the script will restart Controller and restart ResourceManager.
    Are you sure you want to continue connecting (yes/no)?yes
    Please input admin password:
    Begin to backup queues ...
    ...

  4. After the script is successfully executed, choose Cluster > Name of the desired cluster > Services > Yarn on FusionInsight Manager. Click ResourceManager(Active) to go to the ResourceManager WebUI.
  5. Click Scheduler on the left pane and check whether queues of the deleted tenant are cleared.