Help Center/ MapReduce Service/ FAQs/ Job Development/ What Can I Do If a SparkStreaming Job Fails After Running for Dozens of Hours and Error 403 Is Reported for OBS Access?
Updated on 2023-10-19 GMT+08:00

What Can I Do If a SparkStreaming Job Fails After Running for Dozens of Hours and Error 403 Is Reported for OBS Access?

Question: What can I do if a SparkStreaming job fails after running for dozens of hours and error 403 is reported for OBS access?

Answer: When a user submits a job that needs to read and write OBS, the job submission program adds the temporary access key (AK) and secret key (SK) for accessing OBS by default. The temporary AK and SK have expiration time.

If you want to run long-term jobs such as Flink and SparkStreaming jobs, you can enter the AK and SK in Service Parameter to prevent jobs execution failure due to key expiration.