What Do I Do If Error Message "Client cannot authenticate via:[TOKEN, KERBEROS]" Is Displayed When the Tez Engine Is Used to Execute Hive SQL Tasks?

Question

1. When the Tez engine is used to execute Hive SQL tasks in MRS 3.5.1 or later, some queries fail and the following information is included in the displayed error message.
   Figure 1 Hive SQL task execution error
   
2. Log in to the HiveServer node where the job is running and view the /var/log/Bigdata/hive/hiveserver/hive.log file. The file contains message Send dag plan using YARN local resources since it's too large, dag plan size=xxx, max dag plan size through IPC=xxx, max IPC message size=xxx, as shown in Figure 2.
   Figure 2 HiveServer log information
   

Answer

You can increase the value of ipc.maximum.data.length. The default value is 134217728 (128 MB). The new value must be greater than the value of dag plan size in the log. For example, if dag plan size=143378045 is in the log, you can set the value of ipc.maximum.data.length to 268435456 (256 MB).

You can use either of the following methods to configure the value of ipc.maximum.data.length:

• Method 1

  Log in to FusionInsight Manager, choose Cluster > Services > Hive, and click Configurations and then All Configurations. In the navigation pane on the left, choose Hive(Service) > Customization. Add parameter ipc.maximum.data.length to the core-site.xml file, set the parameter value, and click Save. Click the Instances tab and perform a rolling restart for the instances whose configuration has expired to make the configuration take effect.

• Method 2

  Run the following command on the Hive client to set the parameter value:

  set ipc.maximum.data.length=xxx;