What If yarn-session Start Fails When blob.storage.directory Is Set to /home

Updated on 2022-09-14 GMT+08:00

View PDF

Question

When blob.storage.directory is set to /home, the blobStore-UUID file cannot be created in /home. This causes yarn-session start failure

Answer

It is recommended that blob.storage.directory be set to /tmp or /opt/huawei/Bigdata/tmp.
When you set blob.storage.directory to a customized directory, manually grant permissions to the directory. This section takes the admin user of FusionInsight as an example.
1. Modify conf/flink-conf.yaml on the Flink client and run the blob.storage.directory: /home/testdir/testdirdir/xxx command.
2. Create the /home/testdir directory (level 1 is enough) and set the directory to be managed by the admin user.
  
  NOTE:
  
  The testdirdir/xxx directory under the /home/testdir/ directory is automatically created on each node when Flink cluster starts.
3. Run ./bin/yarn-session.sh -jm 2048 -tm 3072 on the client to check that yarn-session is normally started and the directory is successfully created.