Help Center/ MapReduce Service/ FAQs/ Job Management/ Where Are the Execution Logs of Spark Jobs Stored?
Updated on 2025-10-23 GMT+08:00
Where Are the Execution Logs of Spark Jobs Stored?
Question:
Where Are the Execution Logs of Spark Jobs Stored?
Answer:
- Logs of unfinished Spark jobs are stored in the /srv/BigData/hadoop/data1/nm/containerlogs/ directory on the Core node.
- Logs of finished Spark jobs are stored in the /tmp/logs/Username/logs directory of the HDFS.
Parent topic: Job Management
What is your overall rating for this page?
0
1
2
3
4
5
6
7
8
9
10
Very dissatisfiedVery satisfied
Thank you very much for your feedback. We will continue working to improve the documentation.
The system is busy. Please try again later.
