What If yarn-session Start Fails When blob.storage.directory Is Set to /home
Question
When blob.storage.directory is set to /home, the blobStore-UUID file cannot be created in /home. This causes yarn-session start failure
Answer
- It is recommended that blob.storage.directory be set to /tmp or /opt/huawei/Bigdata/tmp.
- When you set blob.storage.directory to a customized directory, manually grant permissions to the directory. This section takes the admin user of FusionInsight as an example.
- Modify conf/flink-conf.yaml on the Flink client and run the blob.storage.directory: /home/testdir/testdirdir/xxx command.
- Create the /home/testdir directory (level 1 is enough) and set the directory to be managed by the admin user.
The testdirdir/xxx directory under the /home/testdir/ directory is automatically created on each node when Flink cluster starts.
- Run ./bin/yarn-session.sh -jm 2048 -tm 3072 on the client to check that yarn-session is normally started and the directory is successfully created.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.