Procedure
This topic introduces the end-to-end procedure for using CSS Logstash to build data ingestion and processing pipelines for enterprise-grade search and analytics platforms, covering key steps from environment setup to application rollout.
| Stage | Key Step | Description | Details |
|---|---|---|---|
| Planning and deployment | Cluster planning | Based on intended use cases, plan node specifications and multiple-AZ deployment in advance to minimize the need for changes after cluster creation. | |
| Creating a cluster | Create a Logstash cluster based on your planning and service requirements. | ||
| Networking and security | Network and security settings | If the Logstash cluster and the data source reside in different VPCs or they can only communicate through the public network, you must configure routes or enable public network access for the Logstash cluster to connect the two. | Configuring Public Network Access |
| Migration tasks | Configuring migration tasks | Through the configuration center of the Logstash cluster, create and start a Logstash configuration file to migrate data between different locations. | |
| Monitoring and observability | Monitoring management | Cloud Eye enables efficient visualization and monitoring of key cluster metrics, allowing the O&M team to monitor cluster health and performance bottlenecks in real time. This helps ensure high service availability. | |
| Log management | The O&M team can analyze run logs and operation audit records to quickly demarcate issues, analyze performance, and ensure security and compliance. Logs can be backed up to OBS for long-term storage, meeting diverse, enterprise-grade operational and auditing requirements. | ||
| Operations and management | Managing cluster changes | You can easily manage cluster changes, such as cluster scaling and changing node specifications, while ensuring service continuity. | |
| Cluster management | Cluster resources can be isolated by enterprise project and tagged for refined management. You can easily restart and delete clusters, ensuring efficient cluster management. |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
