Updated on 2024-08-10 GMT+08:00

Spark2x

Spark2x JAR File Conflict List

JAR File

Description

Solution

spark-core_2.1.1-*.jar

Core JAR file of Spark tasks.

Spark can directly use the open-source Spark JAR file of the same version to run the sample code. However, the serialization IDs of spark-core JAR files of various versions may be different. You are advised to use the JAR file provided by the cluster.

jackson-*.jar

The following error message is reported when the Spark program is executed: com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.11.4 requires Jackson Databind version >= 2.11.0 and < 2.12.0

The version of the Jackson file imported during program execution is inconsistent with that of the package file by the cluster. You are advised to use the Jackson JAR file provided by the cluster in /opt/Bigdata/client/Spark2x/spark/jars.