What Can I Do If a SparkStreaming Job Fails After Running for Dozens of Hours and Error 403 Is Reported for OBS Access?
Question: What can I do if a SparkStreaming job fails after running for dozens of hours and error 403 is reported for OBS access?
Answer: When a user submits a job that needs to read and write OBS, the job submission program adds the temporary access key (AK) and secret key (SK) for accessing OBS by default. The temporary AK and SK have expiration time.
If you want to run long-term jobs such as Flink and SparkStreaming jobs, you can enter the AK and SK in Service Parameter to prevent jobs execution failure due to key expiration.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot