Why Is Hive on Spark Task Freezing When HBase Is Not Installed?

Scenario

This function applies to Hive.

Perform the following operations to configure parameters. When Hive on Spark tasks are executed in the environment where the HBase is not installed, freezing of tasks can be prevented.

The Spark kernel version of Hive on Spark tasks has been upgraded to Spark. Hive on Spark tasks can be executed without installing Spark. If HBase is not installed, when Spark tasks are executed, the system attempts to connect to the ZooKeeper to access HBase until timeout occurs by default. As a result, task freezing occurs.

If HBase is not installed, perform the following operations to execute Hive on Spark tasks. If HBase is upgraded from an earlier version, you do not need to configure parameters after the upgrade.

Procedure

1. Log in to FusionInsight Manager.
2. Choose Cluster > Services > Hive. Click Configurations then All Configurations.
3. Choose HiveServer(Role) > Customization. Add a customized parameter to the spark-defaults.conf parameter file. Set Name to spark.security.credentials.hbase.enabled, and set Value to false.
4. Click Save. In the dialog box that is displayed, click OK.
5. Choose Cluster > Services > Hive. Click Instance, select all Hive instances, click More , and select Restart Instance. In the dialog box displayed, enter the password, and click OK.