What Should I Do If Error Code 403 Is Reported When a Spark Streaming Job Is Running?

Question:

What can I do if a Spark Streaming job fails after running for dozens of hours and error 403 is reported for OBS access?

Answer:

When a user submits a job that needs to read and write OBS, the job submission program adds the temporary access key (AK) and secret key (SK) for accessing OBS by default. However, the temporary AK and SK may expire.

If you want to run long-term jobs such as Flink and SparkStreaming jobs, you can enter the AK and SK in Service Parameter to prevent jobs execution failure due to key expiration.