How Do I Handle a Slow Hive on Spark Task When HBase Is Not Installed?

Scenario

This function applies to Hive.

Perform the following operations to configure parameters. When Hive on Spark tasks are executed in the environment where the HBase is not installed, freezing of tasks can be prevented.

The Spark kernel version of Hive on Spark tasks has been upgraded to Spark2x. Hive on Spark tasks can be executed is Spark2x is not installed. If HBase is not installed, when Spark tasks are executed, the system attempts to connect to the ZooKeeper to access HBase until timeout occurs by default. As a result, task freezing occurs.

If HBase is not installed, perform the following operations to execute Hive on Spark tasks. If HBase is upgraded from an earlier version, you do not need to configure parameters after the upgrade.

Procedure

1. Log in to FusionInsight Manager.
2. Choose Cluster > Name of the desired cluster > Services > Hive > Configurations > All Configurations.
3. Choose HiveServer(Role) > Customization. Add a customized parameter to the spark-defaults.conf parameter file. Set Name to spark.security.credentials.hbase.enabled, and set Value to false.
4. Click Save. In the dialog box that is displayed, click OK.
5. Choose Cluster > Name of the desired cluster > Services > Hive > Instance, select all Hive instances, choose More > Restart Instance, enter the password, and click OK.