Help Center/ MapReduce Service/ User Guide (Kuala Lumpur Region)/ Managing Clusters/ Component Management/ Configuring Customized Service Parameters
Updated on 2022-08-12 GMT+08:00
View PDF
Share

Configuring Customized Service Parameters

Each component of MRS supports all open-source parameters. MRS supports the modification of some parameters for key application scenarios. Some component clients may not include all parameters with open-source features. To modify the component parameters that are not directly supported by MRS, you can add new parameters for components by using the configuration customization function on MRS. Newly added parameters are saved in component configuration files and take effect after restart.

Impact on the System

  • After the service attributes are configured, the service needs to be restarted. The service cannot be accessed during restart.
  • You need to download and update the client configuration files after configuring HBase, HDFS, Hive, Spark, Yarn, and MapReduce service properties.

Prerequisites

  • You have understood the meanings of parameters to be added, configuration files that have taken effect, and the impact on components.
  • You have synchronized IAM users. (On the Dashboard page, click Synchronize on the right side of IAM User Sync to synchronize IAM users.)

Procedure

  1. On the MRS cluster details page, click Components.
  2. Select the target service from the service list.
  3. Click Service Configuration.
  4. In the configuration type drop-down box on the right side, switch Basic to All.
  5. In the navigation tree, select Customization. The customized parameters of the current component are displayed on MRS.

    The configuration files that save the newly added customized parameters are displayed in the Parameter File column. Different configuration files may have same open-source parameters. After the parameters in different files are set to different values, whether the configuration takes effect depends on the loading sequence of the configuration files by components. You can customize parameters for services and roles as required. Adding customized parameters for a single role instance is not supported.

  6. Based on the configuration files and parameter functions, locate the row where a specified parameter resides, enter the parameter name supported by the component in the Parameter column and enter the parameter value in the Value column.

    • You can click or to add or delete a customized parameter. You can delete a customized parameter only after you click for the first time.
    • If you want to cancel the modification of a parameter value, click to restore it.

  7. Click Save Configuration, select Restart the affected services or instances, and click OK.

Task Example

Configuring Customized Hive Parameters

Hive depends on HDFS. By default, Hive accesses the HDFS client. The configuration parameters to take effect are controlled by HDFS in a unified manner. For example, the HDFS parameter ipc.client.rpc.timeout affects the RPC timeout period for all clients to connect to the HDFS server. If you need to modify the timeout period for Hive to connect to HDFS, you can use the configuration customization function. After this parameter is added to the core-site.xml file of Hive, this parameter can be identified by the Hive service and its configuration overwrites the parameter configuration in HDFS.

  1. On the MRS cluster details page, click Components.
  2. Choose Hive > Service Configuration.
  3. In the configuration type drop-down box on the right side, switch Basic to All.
  4. In the navigation tree on the left, select Customization for the Hive service. The system displays the customized service parameters supported by Hive.
  5. In core-site.xml, locate the row that contains the core.site.customized.configs parameter, enter ipc.client.rpc.timeout in the Parameter column, and enter a new value in the Value column, for example, 150000. The unit is millisecond.
  6. Click Save Configuration, select Restart the affected services or instances, and click OK.

    Operation successful is displayed. Click Finish. The service is started successfully.

Parent topic: Component Management