Configuring an OBS Bucket

Updated on 2025-02-17 GMT+08:00

View PDF

You can upload big data verification logs and content verification results to OBS for saving local storage and effectively managing and analyzing logs and results. After an OBS bucket is configured, the task logs and content verification results will be automatically uploaded to the specified OBS bucket.

Required Permissions

Ensure that the Huawei Cloud account that owns the added credentials have the following permissions for the log bucket:

obs:object:PutObject (Uploading objects with PUT or POST, copying objects, appending content to objects, initiating a multipart upload, as well as uploading, copying, and assembling parts)
obs:bucket:ListAllMyBuckets (Listing buckets)
obs:bucket:ListBucket (Listing objects in a bucket)

For details about more permissions, see Permissions Management.

Prerequisites

You have installed the MgC Agent and registered an account.
You have connected the MgC Agent to MgC. For details, see Connecting the MgC Agent to MgC.

Procedure

Use the registered username and password to log in to the MgC Agent console.
In the navigation pane, choose Agent-based Discovery > Big Data.
In the Bucket Configuration area, click Configure.

Configure a log bucket by referring to Table 1.

**Table 1** Parameters for configuring a log bucket
Parameter	Configuration
Bucket Type	Two types are supported: Parallel File System and Bucket.
OBS Endpoint	Enter the endpoint of the region where the log bucket is located. For details, see Regions and Endpoints. Click Verify to obtain the bucket list.
Bucket	Select the desired bucket from the drop-down list.
(Optional) Folder	Specify the folder for storing log files and content verification results in the bucket. The folder path must start with a slash (/). For example, if the bucket name is mgc01 and the folder name is /test, the log file path is obs://mgc01/test/bigdata/task/Date/Task execution ID/Log file. The content verification result path is obs://mgc01/test/bigdata/task/Task execution ID/Database name/Table name/Content verification result file. If you do not specify a folder, the system automatically creates a folder named bigdata in the bucket. Log files are stored in obs://Bucket name/bigdata/task/Date/Task execution ID/Log file. The path for storing the content verification result is obs://Bucket name/bigdata/task/Task execution ID/Database name/Table name/Content verification result file. If the specified folder is not found, the system automatically creates the folder before uploading log files.

Click OK.

NOTICE:

Deleting the bucket configuration does not delete the bucket itself or the files stored in it, but you cannot use the log upload function of MgC.

Parent Topic: Agent-based Discovery

Previous topic: Adding Resource Credentials

Next topic: Managing MgC Agents

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot