Help Center/ MapReduce Service/ FAQs/ Job Management/ What Can I Do If a SparkStreaming Job Fails After Running for Dozens of Hours and Error 403 Is Reported for OBS Access?
Updated on 2024-08-16 GMT+08:00

What Can I Do If a SparkStreaming Job Fails After Running for Dozens of Hours and Error 403 Is Reported for OBS Access?

Question: What can I do if a SparkStreaming job fails after running for dozens of hours and error 403 is reported for OBS access?

Answer: When a user submits a job that needs to read and write OBS, the job submission program adds the temporary access key (AK) and secret key (SK) for accessing OBS by default. The temporary AK and SK have expiration time.

If you want to run long-term jobs such as Flink and SparkStreaming jobs, you can enter the AK and SK in Service Parameter to prevent jobs execution failure due to key expiration.