What Should I Do If yarn-session Failed to Be Started When blob.storage.directory Is Set to /home?
Issue
When blob.storage.directory is set to /home, a user has no permission to create the blobStore-UUID file in /home, causing yarn-session start failure.
Answer
- It is recommended that blob.storage.directory be set to /tmp or /opt/Bigdata/tmp.
- If you set blob.storage.directory to a customized directory, you need to manually assign the owner permission on the directory to the user. The following uses user admin of MRS as an example.
- Modify the Flink client configuration file conf/flink-conf.yaml and configure blob.storage.directory to /home/testdir/testdirdir/xxx.
- Create the /home/testdir directory (level-1 directory is enough) and assign the directory to user admin.
The testdirdir/xxx directory in /home/testdir/ is automatically created on each node when the Flink cluster is started.
- Go to the client path and run ./bin/yarn-session.sh -n 3 -jm 2048 -tm 3072 to check whether yarn-session is normally started and the directory is created.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.