Adding a Data Dump Task Through a VPCEP Channel to the Current Account
In data dump scenarios, Cloud Eye metrics or events need to be forwarded to your Kafka instances. There is a hidden and invisible default channel. This channel which may raise customers' concerns about data security. To address this issue, Cloud Eye provides a new secure access channel called Virtual Private Cloud Endpoint (VPCEP). With VPCEP, you can securely transfer data to your Kafka instance, ensuring security of data transmission.
This topic describes how to use VPCEP for data dump.
Constraints
- The data dump function is currently in restricted use. To use it, submit a service ticket.
- VPCEP channels are available only in certain regions. You can log in to the console and check if they are available in your target region.
- VPCEP channels can only dump data to Distributed Message Service (DMS) for Kafka.
- By default, VPCEP channels dump data to only the current account.
- You can create a maximum of 20 data dump tasks per account.
- The target Kafka cluster can only use the default certificate of DMS for Kafka. Data dump may fail if:
- The target Kafka cluster uses a custom certificate when you add a dump task.
- The default certificate of the Kafka cluster is replaced with a custom certificate after a dump task is added.
- When adding a dump task through a VPCEP channel, ensure that ciphertext access is enabled for the Kafka instance, the security protocol is SASL_SSL, and the PLAIN authentication mechanism is enabled. Otherwise, data cannot be dumped.
- When you add a dump task, if a task with the same resource type (data source), dump channel, Kafka instance, and topic as the task to be added already exists in the task list, the task cannot be added again.
Prerequisites
- Ensure that your account has the Security Administrator permissions, or a message indicating abnormal permissions will be displayed. In this case, contact the account administrator to grant the permissions.
- You have obtained the username and password for connecting to Kafka instances.
- Ensure that no VPCEP service has been created in the VPC associated with the selected Kafka instance. For details, see What Should I Do If "VPCEP channel error" Is Displayed When I Add a Dump Task Using a VPCEP Channel?
Billing
- After you add a data dump task through a VPCEP channel, you will be billed based on the VPCEP running duration and data volume. For details, see Billings Items and Payer Description.
- If you manually disable a dump task using the Disabling a Dump Task function or the dump task status is disabled because the connection request of the VPC endpoint service is rejected, fees will still be generated. If you no longer need to use these resources and want to stop being billed for them, delete these resources to stop billing.
Adding a Data Dump Task Through a VPCEP Channel to the Current Account
- Log in to the Cloud Eye console.
- In the navigation pane, choose Data Dump.
- Click Add Dump Task in the upper right corner.
- On the displayed page, set parameters.
Table 1 Task parameters Parameter
Description
Example Value
Name
Name of the data dump task. The system generates a random name, which you can change.
The name can contain a maximum of 64 characters, including letters digits, underscores (_), and hyphens (-).
dataShareJob-ECSMetric
Table 2 Data source parameters Parameter
Description
Example Value
Resource Type
Type of resources monitored by Cloud Eye.
Elastic Cloud Server
Dimension
Dimension of the monitored object, which is used to filter monitoring data. You can select all dimensions or specified dimensions supported by a cloud service.
For details about the dimensions of each service, see their documents. You can access the documents via references listed on Cloud Product Metrics. For details about dimensions, see Dimensions.- If you select All, all monitored objects of the service will be dumped to the destination cloud service.
- If you select a specified dimension, only metrics of this dimension will be dumped to the destination cloud service.
All
Monitoring Scope
Currently, only All resources is supported, indicating that metric data of all resources in the specified dimension will be dumped to the destination cloud service.
All resources
Table 3 Destination parameters Parameter
Description
Example Value
Task Channel
Channel of a data dump task. You can select VPCEP channel or Default channel.
VPCEP channel
Resource Type
Destination cloud service of the dumped data. For VPCEP channels, data can be dumped to Distributed Message Service for Kafka Premium.
Distributed Message Service for Kafka Premium
Project Name
IAM project name of the account for saving dumped data.
-
Kafka
Name of the Kafka instance to which data is dumped.
If no Kafka instance is available, see Buying a Kafka Instance.
-
Topic
Name of the Kafka topic to which data is dumped.
If no topic is available, see Creating a Kafka Topic.
-
DMS Username
Username for the client to connect to a Kafka instance.
-
DMS Password
Password for the client to connect to a Kafka instance.
-
- Click Add after the configuration is complete.
You can query the dumped data in Kafka. For details, see Viewing Kafka Messages.
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot