Help Center/ Migration Center/ Tool Guide/ Edge Discovery/ Configuring an OBS Bucket
Updated on 2024-12-02 GMT+08:00
View PDF
Share

Configuring an OBS Bucket

You can upload big data verification logs and content verification results to OBS for saving local storage and effectively managing and analyzing logs and results. After an OBS bucket is configured, the task logs and content verification results will be automatically uploaded to the specified OBS bucket.

Required Permissions

Ensure that the Huawei Cloud account that owns the added credentials have the following permissions for the log bucket:

  • obs:object:PutObject (Uploading objects with PUT or POST, copying objects, appending content to objects, initiating a multipart upload, as well as uploading, copying, and assembling parts)
  • obs:bucket:ListAllMyBuckets (Listing buckets)
  • obs:bucket:ListBucket (Listing objects in a bucket)

For details about more permissions, see Permissions Management.

Prerequisites

Procedure

  1. Use the registered username and password to log in to the Edge console.
  2. In the navigation pane, choose Edge Discovery > Big Data.
  3. In the Bucket Configuration area on the Edge credential management page, click Configure.
  4. Configure a log bucket by referring to Table 1.

    Table 1 Parameters for configuring a log bucket

    Parameter

    Configuration

    Bucket Type

    Two types are supported: Parallel File System and Bucket.

    OBS Endpoint

    Enter the endpoint of the region where the log bucket is located. For details, see Regions and Endpoints. Click Verify to obtain the bucket list.

    Bucket

    Select the desired bucket from the drop-down list.

    (Optional) Folder

    Specify the folder for storing log files and content verification results in the bucket. The folder path must start with a slash (/). For example, if the bucket name is mgc01 and the folder name is /test, the log file path is obs://mgc01/test/bigdata/task/Date/Task execution ID/Log file. The content verification result path is obs://mgc01/test/bigdata/task/Task execution ID/Database name/Table name/Content verification result file.

    • If you do not specify a folder, the system automatically creates a folder named bigdata in the bucket.
      • Log files are stored in obs://Bucket name/bigdata/task/Date/Task execution ID/Log file.
      • The path for storing the content verification result is obs://Bucket name/bigdata/task/Task execution ID/Database name/Table name/Content verification result file.
    • If the specified folder is not found, the system automatically creates the folder before uploading log files.

  5. Click OK.

    Deleting the bucket configuration does not delete the bucket itself or the files stored in it, but you cannot use the log upload function of MgC.

Parent topic: Edge Discovery