How Do I Enable Different Service Programs to Use Different Yarn Queues?

Question:

How Do I Enable Different Service Programs to Use Different Yarn Queues?

Answer:

Create a tenant on FusionInsight Manager and bind different cluster service users to different tenants.

Procedure

1. Log in to FusionInsight Manager and choose Tenant Resources.
2. In the tenant list on the left, select a parent tenant and click . On the page for adding a sub-tenant, set properties for the sub-tenant according to Table 1.

   Table 1 Sub-tenant parameters

   Parameter	Description
   Cluster	Cluster to which the parent tenant belongs.
   Parent Tenant	Name of the parent tenant.
   Name	Name of the current tenant. The value consists of 3 to 50 characters, including digits, letters, and underscores (_). Plan a sub-tenant name based on service requirements. The name cannot be the same as that of a role, HDFS directory, or Yarn queue that exists in the current cluster.
   Tenant Type	Whether the tenant is a leaf tenant. When Leaf Tenant is selected, the current tenant is a leaf tenant and no sub-tenant can be added. When Non-leaf Tenant is selected, the current tenant is not a leaf tenant and sub-tenants can be added to the current tenant. However, the tenant depth cannot exceed 5 levels.
   Computing Resource	Dynamic compute resources for the current tenant. When Yarn is selected, the system automatically creates a queue in YARN and the queue is named the same as the sub-tenant name. A leaf tenant can directly submit jobs to the queue. A non-leaf tenant cannot directly submit jobs to the queue. However, YARN adds an extra queue (hidden) named default for the non-leaf tenant to record the remaining resource capacity of the tenant. Actual jobs do not run in this queue. If Yarn is not selected, the system does not automatically create a queue.
   Default Resource Pool Capacity (%)	Percentage of computing resources used by the current tenant. The base value is the total resources of the parent tenant.
   Default Resource Pool Max Capacity (%)	Maximum percentage of computing resources used by the current tenant. The base value is the total resources of the parent tenant.
   Storage Resource	Storage resources for the current tenant. When HDFS is selected, the system automatically creates a folder named after the sub-tenant in the HDFS parent tenant directory. When HDFS is not selected, the system does not automatically allocate storage resources.
   Quota	Quota for files and directories.
   Space Quota	Quota for the HDFS storage space used by the current tenant. If the unit is set to MB, the value ranges from 1 to 8796093022208. If the unit is set to GB, the value ranges from 1 to 8589934592. This parameter indicates the maximum HDFS storage space that can be used by the tenant, but not the actual space used. If its value is greater than the size of the HDFS physical disk, the maximum space available is the full space of the HDFS physical disk. If this quota is greater than the quota of the parent tenant, the actual storage space does not exceed the quota of the parent tenant.
   Storage Path	HDFS storage directory for the tenant. The system automatically creates a folder named after the sub-tenant name in the directory of the parent tenant by default. For example, if the sub-tenant is ta1s and the parent directory is /tenant/ta1, the storage path for the sub-tenant is then /tenant/ta1/ta1s. The storage path is customizable in the parent directory.
   Description	Description of the current tenant.

   

   Roles, computing resources, and storage resources are automatically created when tenants are created.

   • The new role has permissions on the computing and storage resources. This role and its permissions are automatically controlled by the system and cannot be manually managed by choosing System > Permission > Role. The role name is in the format of Tenant name_Cluster ID. The ID of the first cluster is not displayed by default.
   • When using this tenant, create a system user and bind the user to the role of the tenant.
   • The sub-tenant can further allocate the resources of its parent tenant. The sum of the resource percentages of direct sub-tenants under a parent tenant at each level cannot exceed 100%. The sum of the computing resource percentages of all level-1 tenants cannot exceed 100%.

3. Check whether the current tenant needs to be associated with resources of other services.
   • If yes, go to 4.
   • If no, go to 5.

4. Click Associate Service to configure other service resources used by the current tenant.
   1. Set Services to HBase.
   2. Set Association Type as follows:
      • Exclusive indicates that the service resources are used by the tenant exclusively and cannot be associated with other tenants.
      • Shared indicates that the service resources can be shared with other tenants.
   

   • Only HBase can be associated with a new tenant. However, HDFS, HBase, and Yarn can be associated with existing tenants.
   • To associate an existing tenant with service resources, click the target tenant in the tenant list, switch to the Service Associations page, and click Associate Service to configure resources to be associated with the tenant.
   • To disassociate an existing tenant from service resources, click the target tenant in the tenant list, switch to the Service Associations page, and click Delete in the Operation column. In the displayed dialog box, select I have read the information and understand the impact and click OK.
   3. Click OK.

5. Click OK. Wait until the system displays a message indicating that the tenant is successfully created.