Updated on 2023-12-04 GMT+08:00

Accessing OBS from a Client on a Node Outside the Cluster

Scenario

In the OBS decoupled storage and compute scenario, obtain a temporary AK/SK through an agency to access the OBS server. To access OBS from a client on a node outside the cluster, obtain an AK/SK through Guardian. Guardian is an MRS self-developed component that helps clients outside the cluster access OBS through temporary AKs/SKs.

This function is available in MRS 3.1.5 or later.

How Does Guardian Enable a Client on a Node Outside the Cluster to Access OBS?

  1. Install Guardian in the cluster.

    • For a new cluster in creation, select Guardian.
      Figure 1 Selecting Guardian
    • For an existing cluster, add the Guardian component in the Components tab.
      1. On the cluster details page, choose Components and click Add Service.
      2. In the service list, select the services to be added and click Next.
        Figure 2 Adding Guardian
      3. On the Topology Adjustment page, select the node where the service is to be deployed. (You are advised to deploy the Guardian service on the master node.)
      4. Click OK. After the service is added, you can view the added service on the Components page.

        The services added on the console are automatically synchronized to Manager.

  2. Configure storage and compute decoupling for the cluster by referring to Configuring a Storage-Compute Decoupled Cluster (Agency) or Configuring Fine-Grained Permissions for MRS Multi-User Access to OBS.
  3. Install or update the client.

  4. After the installation is successful, you can access OBS.

    Example:

    If the client directory is /opt/client, run the source /opt/client/bigdata_env command. Use the actual client installation path.

    Run the hdfs dfs -ls obs command.

    If the information in the following figure is displayed, the installation is successful:

    Figure 3 Accessing OBS