Help Center/ MapReduce Service/ Developer Guide (Normal_3.x)/ Flink Development Guide (Security Mode)/ More Information/ FAQ/ What If yarn-session Start Fails When blob.storage.directory Is Set to /home
Updated on 2023-04-10 GMT+08:00
View PDF
Share

What If yarn-session Start Fails When blob.storage.directory Is Set to /home

Question

When blob.storage.directory is set to /home, the blobStore-UUID file cannot be created in /home. This causes yarn-session start failure

Answer

  1. It is recommended that blob.storage.directory be set to /tmp or /opt/huawei/Bigdata/tmp.
  2. When you set blob.storage.directory to a customized directory, manually grant permissions to the directory. This section takes the admin user of FusionInsight as an example.

    1. Modify conf/flink-conf.yaml on the Flink client and run the blob.storage.directory: /home/testdir/testdirdir/xxx command.
    2. Create the /home/testdir directory (level 1 is enough) and set the directory to be managed by the admin user.

      The testdirdir/xxx directory under the /home/testdir/ directory is automatically created on each node when Flink cluster starts.

    3. Run ./bin/yarn-session.sh -jm 2048 -tm 3072 on the client to check that yarn-session is normally started and the directory is successfully created.

Parent topic: FAQ