Delivering Logs to OBS
Scenarios
This topic walks you through how to deliver logs to an OBS bucket. The main steps are as follows:
Step 1: Create a Data Delivery Task
Limitations and Constraints
- When performing cross-account delivery, the data can only be delivered to the pipelines instead of cloud services of other accounts.
- If the new data delivery is cross-account, you need to log in to SecMaster using the destination account and perform authorization.
Step 1: Create a Data Delivery Task
- Log in to the management console.
- Click in the upper left corner of the management console and select a region or project.
- Click in the upper left corner of the page and choose Security & Compliance > SecMaster.
- In the navigation pane on the left, choose Workspaces > Management. In the workspace list, click the name of the target workspace.
Figure 1 Workspace management page
- In the navigation pane on the left, choose
. The security analysis page is displayed.Figure 2 Accessing the Security Analysis tab page
- In the data space navigation tree on the left, click the data space name to expand all pipelines. Next to the name of the target pipeline, click More > Deliver.
Figure 3 Accessing data delivery settings page
- (Optional) Confirm the authorization information, select Agree to authorize, and click OK.
Authorization is required first time you start a delivery to a specific destination type. If the destination type has been authorized, skip this step.
- On the Create Delivery panel, set data delivery parameters.
- Configure basic information.
Table 1 Basic Information Parameter
Description
Delivery Name
The name you specify for the delivery.
Resource Consumption
The value is generated by default. You do not need to configure it.
- Configure the data source.
In the Data Source Settings area, the details about the current pipeline are displayed. You do not need to set this parameter.
Table 2 Data source parameters Parameter
Description
Delivery Type
Delivery destination type. The default value is PIPE.
Region
Region where the current pipeline is located.
Workspaces
Workspace to which the current pipeline belongs.
Data Space
Data space to which the current pipeline belongs.
Pipeline
Name of the pipeline.
Data Read Policy
Data read policy of the current pipeline.
Read By
Identity of the data source reader.
- Configure the delivery destination.
- OBS: Deliver the pipeline data to OBS. For details about the parameter settings, see Table 3.
Note that the OBS bucket you use must have private, public read, or public read/write policy enabled. Currently, parallel file buckets are not supported. For details, see Creating an OBS Bucket.
Table 3 Data delivery destination - OBS Parameter
Description
Account Type
Account type for the data delivery destination. When you deliver data to OBS, only the Current account type can be selected.
Delivery Type
Delivery type. Select OBS in this case.
Bucket Name
Name of the destination OBS bucket.
Written To
The value is generated by default. You do not need to configure it.
- OBS: Deliver the pipeline data to OBS. For details about the parameter settings, see Table 3.
- Under Access Authorization, view the permissions granted in 7.
A delivery requires the read and write permissions to access your cloud resources. A delivery task cannot access your cloud resources unless the access is authorized by you.
- Configure basic information.
- Click OK.
Step 2: Authorize the Data Delivery
- Log in to the management console.
- Click in the upper left corner of the management console and select a region or project.
- Click in the upper left corner of the page and choose Security & Compliance > SecMaster.
- In the navigation pane on the left, choose Workspaces > Management. In the workspace list, click the name of the target workspace.
Figure 4 Workspace management page
- In the navigation pane on the left, choose Data Delivery tab. . On the Security Analysis page displayed, click the
- On the Data Delivery tab, click the Cross-Tenant Permissions tab. On the page displayed, click Accept in the Operation column of the target delivery task.
To accept authorization in batches, select all tasks to be authorized and click Accept in the upper left corner above the list.
Figure 5 Data delivery authorization
After the authorization is granted, the authorization status of the target delivery task is updated to Authorized. You can go to the delivery destination to view the delivery details.
Step 3: View the Delivered Data in OBS
- Log in to the management console.
- Click in the upper left corner of the management console and select a region or project.
- Click in the upper left corner of the page and choose . The bucket list page is displayed.
- On the bucket list page, click the name of the OBS bucket selected for data delivery. The details page of the target OBS bucket is displayed.
- On the OBS bucket details page, view the delivery log information.
Operations Related to Data Delivery Authorization
On the Cross-tenant Permissions tab page, you can select to Reject or Cancel the authorization.
Operation |
Method |
---|---|
Reject |
In the row containing the target delivery task, click Reject in the Operation column to reject the authorization. To reject authorization in batches, select all tasks to be rejected and click Reject in the upper left corner of the list. |
Cancel |
|
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.