Configuration Process

With MRS, you can store data in OBS and dedicate MRS clusters solely to computing tasks, isolating storage and compute resources. This approach offers flexible, on-demand scaling at a lower cost, making it well-suited for big data processing.

In storage-compute decoupling scenarios, make sure to use an OBS parallel file system. For details, see Parallel File System. Using a regular object bucket can significantly impact the performance of the cluster.
If a cluster has been connected to OBS (storage and compute decoupling or cold and hot data separation), you need to manually delete service data on OBS after deleting a component or MRS cluster.
After storage-compute decoupling is configured for the MRS cluster, components can access the OBS file system and the HDFS in the cluster. For details, see Interconnecting an MRS Cluster with OBS Using an IAM Agency.

Perform the following steps to use the storage-compute decoupling function:

Configure a cluster with decoupled storage and compute.
Select one of the following configurations (Using an agency is recommended.):
- Bind an agency of the ECS type to an MRS cluster to access OBS, preventing the AK/SK from being exposed in the configuration file. For details, see Interconnecting an MRS Cluster with OBS Using an IAM Agency.
- Configure the AK/SK in an MRS cluster. The AK/SK will be exposed in the configuration file in plaintext. Exercise caution when performing this operation. For details, see How Do I Connect an MRS Cluster Client to OBS Using an AK/SK Pair?.
Use the cluster.
After the required permissions for accessing OBS are obtained, components in the MRS cluster can access the corresponding files through the client.

For details about how to configure components to access OBS, see the following content:
- Example for Interconnecting a Cluster Service with OBS