Help Center/ MapReduce Service/ User Guide (Kuala Lumpur Region)/ MRS Cluster Component Operation Gudie/ Using Spark2x/ Common Issues About Spark2x/ Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?
Updated on 2022-12-14 GMT+08:00
View PDF
Share

Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?

Question

When the OBS ECS/BMS image cluster is connected, after spark-beeline is logged in, an error is reported when a location is specified to create a table on OBS.

Figure 1 Error message

Answer

The permission on the ssl.jceks file in HDFS is insufficient. As a result, the table fails to be created.

Solution

  1. Log in to the node where Spark2x resides as user omm and run the following command:

    vi ${BIGDATA_HOME}/FusionInsight_Spark2x_8.1.0.1/install/FusionInsight-Spark2x-3.1.1/spark/sbin/fake_prestart.sh

  2. Change eval "${hdfsCmd}" -chmod 600 "${InnerHdfsDir}"/ssl.jceks >> "${PRESTART_LOG}" 2>&1 to eval "${hdfsCmd}" -chmod 644 "${InnerHdfsDir}"/ssl.jceks >> "${PRESTART_LOG}" 2>&1.
  3. Restart the SparkResource instance.