Spark2x
Spark2x JAR File Conflict List
| JAR File | Description | Solution |
|---|---|---|
| spark-core_2.1.1-*.jar | Core JAR file of Spark tasks. | Spark can directly use the open-source Spark JAR file of the same version to run the sample code. However, the serialization IDs of spark-core JAR files of various versions may be different. You are advised to use the JAR file provided by the cluster. |
| jackson-*.jar | The following error message is reported when the Spark program is executed: com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.11.4 requires Jackson Databind version >= 2.11.0 and < 2.12.0 | The version of the Jackson file imported during program execution is inconsistent with that of the package file by the cluster. You are advised to use the Jackson JAR file provided by the cluster in /opt/Bigdata/client/Spark2x/spark/jars. |
Last Article: Kafka
Next Article: Security Authentication
Did this article solve your problem?
Thank you for your score!Your feedback would help us improve the website.