Help Center > > User Guide> MRS Cluster Component Operation Guide> Using Alluxio> Configuring an Underlying Storage System

Configuring an Underlying Storage System

Updated at: Apr 28, 2020 GMT+08:00

If you want to use a unified client API and a global namespace to access persistent storage systems including HDFS and OBS to separate computing from storage, you can configure the underlying storage system of Alluxio on MRS Manager. After a cluster is created, the default underlying storage address is hdfs://hacluster/, that is, the HDFS root directory is mapped to Alluxio.

Prerequisites

  • Alluxio has been installed in a cluster.
  • The password of user admin has been obtained. The password of user admin is specified by you during MRS cluster creation.

Configuring HDFS as the Underlying File System of Alluxio

  1. Log in to MRS Manager. For details, see Accessing MRS Manager. Then, choose Services > Alluxio.
  2. On the MRS management console, click the cluster name to go to the cluster details page.
  3. Choose Components > Alluxio.
  4. On the Service Configuration tab page, set Type to All. The Alluxio configuration page is displayed.
  5. In the left pane, choose Alluxio > Under Stores, and modify the value of alluxio.master.mount.table.root.ufs to hdfs://hacluster/XXX/.

    For example, if you want to use HDFS root directory/alluxio/ as the root directory of Alluxio, modify the value of alluxio.master.mount.table.root.ufs to hdfs://hacluster/alluxio/.

  6. Click Save Configuration. In the displayed dialog box, select Restart the affected services or instances.
  7. Click OK to restart Alluxio.

Configuring Huawei OBS as the Underlying File System of Alluxio

Method 1:

  1. Configure an agency with the OBS OperateAccess permission for the cluster. For details, see Accessing OBS Using an ECS Agency.
  2. Log in to MRS Manager. For details, see Accessing MRS Manager. Then, choose Services > Alluxio.
  3. On the Service Configuration tab page, set Type to All. The Alluxio configuration page is displayed.
  4. In the left pane, choose Alluxio > Under Stores, and modify the value of alluxio.master.mount.table.root.ufs to obs://<OBS_BUCKET>/<OBS_DIRECTORY>/. OBS_BUCKET is the name of an existing OBS bucket, and OBS_DIRECTORY is the directory in the bucket.
  5. Click Save Configuration. In the displayed dialog box, select Restart the affected services or instances.
  6. Click OK to restart Alluxio.

Method 2:

  1. Configure an agency with the OBS OperateAccess permission for the cluster. For details, see Accessing OBS Using an ECS Agency.
  2. Log in to the active Master node. For details about how to determine an active node, see Determining Active or Standby Management Nodes of MRS Manager.
  3. Run the following command to configure environment variables:

    source /opt/client/bigdata_env

  4. Run the following command to mount the internal directory of an OBS container to the /obs directory of Alluxio:

    alluxio fs mount /obs obs://<OBS_BUCKET>/<OBS_DIRECTORY>/

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?







Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel