Why Is Hive on Spark Task Freezing When HBase Is Not Installed?
Question
How to handle Hive on Spark task lag when HBase is not installed?
Cause Analysis
The Spark kernel version of Hive on Spark tasks has been upgraded to Spark2x. Hive on Spark tasks can be executed is Spark2x is not installed.If HBase is not installed, when Spark tasks are executed, the system attempts to connect to the ZooKeeper to access HBase until timeout occurs by default. As a result, task freezing occurs.
If HBase is not installed, perform the Procedure to execute Hive on Spark tasks.
Procedure
- Log in to FusionInsight Manager.
- Choose Cluster > Services > Hive > Configurations > All Configurations.
- Choose HiveServer(Role) > Customization. Add a customized parameter to the spark-defaults.conf parameter file. Set Name to spark.security.credentials.hbase.enabled, and set Value to false.
- Click Save. In the dialog box that is displayed, click OK.
- Click Instances, select all Hive instances, choose More > Restart Instance, enter the password, and click OK.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot