Help Center/ MapReduce Service/ Component Operation Guide (LTS) (Ankara Region)/ Using Spark/ Spark FAQ/ Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?
Updated on 2024-11-29 GMT+08:00
View PDF
Share

Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?

Question

When the OBS ECS/BMS image cluster is connected, after spark-beeline is logged in, an error is reported when a location is specified to create a table on OBS.

Figure 1 Error message

Answer

The permission on the ssl.jceks file in HDFS is insufficient. As a result, the table fails to be created.

Solution

  1. Log in to the node where Spark is as user omm and run the following command:

    vi ${BIGDATA_HOME}/FusionInsight_Spark_8.1.0.1/install/FusionInsight-Spark-*/spark/sbin/fake_prestart.sh

  2. Change eval "${hdfsCmd}" -chmod 600 "${InnerHdfsDir}"/ssl.jceks >> "${PRESTART_LOG}" 2>&1 to eval "${hdfsCmd}" -chmod 644 "${InnerHdfsDir}"/ssl.jceks >> "${PRESTART_LOG}" 2>&1.
  3. Restart the SparkResource instance.
Parent topic: Spark FAQ