Help Center/
MapReduce Service/
Component Operation Guide (LTS)/
Using CarbonData/
Common Issues About CarbonData/
Why Data loading Fails During off heap?
Updated on 2025-03-17 GMT+08:00
Why Data loading Fails During off heap?
Question
Why Data Loading fails during off heap?
Answer
YARN Resource Manager will consider (Java heap memory + spark.yarn.am.memoryOverhead) as memory limit, so during the off heap, the memory can exceed this limit.
You need to set spark.yarn.am.memoryOverhead in the spark-defaults.conf file to increase the memory size.
Parent topic: Common Issues About CarbonData
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.
The system is busy. Please try again later.
