Help Center/ MapReduce Service/ User Guide/ Configuring a Cluster with Decoupled Storage and Compute/ Interconnecting with OBS Using the Cluster Agency Mechanism/ Interconnecting MRS with OBS Using an Agency/ Interconnecting MapReduce with OBS

Updated on 2024-04-11 GMT+08:00

View PDF

Interconnecting MapReduce with OBS

Before performing the following operations, ensure that you have configured a storage-compute decoupled cluster by referring to Configuring a Storage-Compute Decoupled Cluster (Agency) or Configuring a Storage-Compute Decoupled Cluster (AK/SK).

Log in to the MRS management console and click the cluster name to go to the cluster details page.
Choose Components > MapReduce. The All Configurations page is displayed. In the navigation tree on the left, choose MapReduce > Customization. In the customized configuration items, add the configuration item mapreduce.jobhistory.always-scan-user-dir to core-site.xml and set its value to true.

Figure 1 Adding a custom parameter
Save the configurations and restart the MapReduce service.

Parent topic: Interconnecting MRS with OBS Using an Agency

Previous topic: Interconnecting Hive with OBS

Next topic: Interconnecting Spark2x with OBS

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel