Authentication Fails When Spark Connects to Kafka

Issue

When Spark consumes Kafka data, an authentication failure occurs one day later.

Symptom

In an MRS 2.1.0 cluster, when Spark consumes Kafka data, an authentication failure occurs one day later.

Cause Analysis

The cluster version does not match the version of the running program package.

Procedure

1. Complete the configuration by referring to Running the "Connecting Spark Streaming to Kafka0-10" Sample Application.
2. Obtain the spark-streaming-kafka-0-10_2.11-2.3.2-mrs-2.1.jar package if you need to use the sample programs provided by the Maven, because the current cluster version is MRS 2.1.0.