Data Transfer
DSC collects logs from applications (including DBSS and API data security protection) to assist in tracking data flow and promptly identifying exceptions and risks.
- Call chain data collection: DSC collects log data of each application. Traces all applications in the entire invoking process, generates logs, and reports the logs to Kafka, such as logs of major microservices APIG, DBSS, API security gateway, and ELB. (Only DBSS is involved in phase 1.)
- Trace data storage and query: The collected data needs to be stored. The log data volume is large. Therefore, both storage and quick query are required.
- Call chain data generation: DSC analyzes the data link flow of the collected and reported logs and draws the flow diagram.
- Counter calculation, storage, and query: Calculates various counters based on the collected log data and saves the calculation results.
Prerequisites
DBSS has been enabled and the database instance has been installed. For details about how to enable DBSS, see Purchasing Database Audit.
Enabling Transfer Log Collection
After you enable the collection of data flow logs of an instance, DSC performs data flow analysis on the collected logs and draws a flow diagram. It calculates various metrics based on the log data and saves the results.
- Log in to the DSC console.
- Click
in the upper left corner of the management console and select a region or project. - In the navigation pane on the left, choose . The Data Transfer Analysis tab page is displayed.
- Click the Transfer Log Collection tab page. For details, see Table 1.
Table 1 Instance list Parameter
Description
Instance Name/ID
Instance name of the interconnected microservice, for example, DBSS. If no instance is available, buy one.
Instance Type
Instance type, which can be DBSS.
Instance Status
Status of an instance
- Not Opened: Data transfer log collection is not enabled.
- Opening: Data transfer log collection is being enabled.
- Open Failed: Failed to enable data transfer log collection.
- Running: Data transfer log collection is enabled successfully.
- Offline: The instance status is abnormal and no heartbeat message is received.
- Disabling Failed: Failed to disable data transfer log collection.
- Disabling: Data transfer log collection is being disabled.
- Abnormal: The instance status is abnormal.
Last Heartbeat Time
Time when DSC was connected to the instance last time.
- In the Data transfer log collection status column, Click
to enable log collection. You can also select multiple instances and click Batch Enable Transfer Collection in the upper left corner to enable log collection for them at a time.
Checking Data Transfer Analysis Results
End-to-end cloud data flow monitoring involves the following phases:
- Analyze transfer paths between the cloud database, data source, and destination server.
- Perform full-link association analysis to measure and map the complete, real-time cloud data flow.
- Log in to the DSC console.
- Click
in the upper left corner and select a region or project. - In the navigation pane on the left, choose . The Data Transfer Analysis tab page is displayed.
- Hovering over a transfer stream displays its transmission encryption status and the total accesses. The color of the connection line indicates its current encryption status: red for unencrypted, green for fully encrypted, and yellow for partially encrypted.
- Configure the analysis scope. Set a time range, and select options from the following drop-down list:
Select a DB
Select an ECS
Select an egress type: Select ELB.
Select an external IP address
Select a sensitivity level
Select a sensitivity label
Related Operations
Disabling data transfer log collection: On the Transfer Log Collection tab page, click
in the Data transfer log collection status column of an instance to disable log collection. You can also select multiple instances and click Disabling Transfer Collection in Batches to disable log collection for them at a time.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot