Compute
Elastic Cloud Server
Huawei Cloud Flexus
Bare Metal Server
Auto Scaling
Image Management Service
Dedicated Host
FunctionGraph
Cloud Phone Host
Huawei Cloud EulerOS
Networking
Virtual Private Cloud
Elastic IP
Elastic Load Balance
NAT Gateway
Direct Connect
Virtual Private Network
VPC Endpoint
Cloud Connect
Enterprise Router
Enterprise Switch
Global Accelerator
Management & Governance
Cloud Eye
Identity and Access Management
Cloud Trace Service
Resource Formation Service
Tag Management Service
Log Tank Service
Config
OneAccess
Resource Access Manager
Simple Message Notification
Application Performance Management
Application Operations Management
Organizations
Optimization Advisor
IAM Identity Center
Cloud Operations Center
Resource Governance Center
Migration
Server Migration Service
Object Storage Migration Service
Cloud Data Migration
Migration Center
Cloud Ecosystem
KooGallery
Partner Center
User Support
My Account
Billing Center
Cost Center
Resource Center
Enterprise Management
Service Tickets
HUAWEI CLOUD (International) FAQs
ICP Filing
Support Plans
My Credentials
Customer Operation Capabilities
Partner Support Plans
Professional Services
Analytics
MapReduce Service
Data Lake Insight
CloudTable Service
Cloud Search Service
Data Lake Visualization
Data Ingestion Service
GaussDB(DWS)
DataArts Studio
Data Lake Factory
DataArts Lake Formation
IoT
IoT Device Access
Others
Product Pricing Details
System Permissions
Console Quick Start
Common FAQs
Instructions for Associating with a HUAWEI CLOUD Partner
Message Center
Security & Compliance
Security Technologies and Applications
Web Application Firewall
Host Security Service
Cloud Firewall
SecMaster
Anti-DDoS Service
Data Encryption Workshop
Database Security Service
Cloud Bastion Host
Data Security Center
Cloud Certificate Manager
Edge Security
Situation Awareness
Managed Threat Detection
Blockchain
Blockchain Service
Web3 Node Engine Service
Media Services
Media Processing Center
Video On Demand
Live
SparkRTC
MetaStudio
Storage
Object Storage Service
Elastic Volume Service
Cloud Backup and Recovery
Storage Disaster Recovery Service
Scalable File Service Turbo
Scalable File Service
Volume Backup Service
Cloud Server Backup Service
Data Express Service
Dedicated Distributed Storage Service
Containers
Cloud Container Engine
SoftWare Repository for Container
Application Service Mesh
Ubiquitous Cloud Native Service
Cloud Container Instance
Databases
Relational Database Service
Document Database Service
Data Admin Service
Data Replication Service
GeminiDB
GaussDB
Distributed Database Middleware
Database and Application Migration UGO
TaurusDB
Middleware
Distributed Cache Service
API Gateway
Distributed Message Service for Kafka
Distributed Message Service for RabbitMQ
Distributed Message Service for RocketMQ
Cloud Service Engine
Multi-Site High Availability Service
EventGrid
Dedicated Cloud
Dedicated Computing Cluster
Business Applications
Workspace
ROMA Connect
Message & SMS
Domain Name Service
Edge Data Center Management
Meeting
AI
Face Recognition Service
Graph Engine Service
Content Moderation
Image Recognition
Optical Character Recognition
ModelArts
ImageSearch
Conversational Bot Service
Speech Interaction Service
Huawei HiLens
Video Intelligent Analysis Service
Developer Tools
SDK Developer Guide
API Request Signing Guide
Terraform
Koo Command Line Interface
Content Delivery & Edge Computing
Content Delivery Network
Intelligent EdgeFabric
CloudPond
Intelligent EdgeCloud
Solutions
SAP Cloud
High Performance Computing
Developer Services
ServiceStage
CodeArts
CodeArts PerfTest
CodeArts Req
CodeArts Pipeline
CodeArts Build
CodeArts Deploy
CodeArts Artifact
CodeArts TestPlan
CodeArts Check
CodeArts Repo
Cloud Application Engine
MacroVerse aPaaS
KooMessage
KooPhone
KooDrive

Using Cloud Eye to Monitor Logstash Clusters

Updated on 2024-10-12 GMT+08:00

You can use Cloud Eye to monitor created CSS clusters. After configuring cluster monitoring, you can log in to the Cloud Eye management console to view cluster metrics.

The procedure for configuring cluster monitoring:

  1. Creating Alarm Rules: Customize alarm rules for the monitoring metrics. Once a metric exceeds the threshold, the system will notify you via email or HTTP/HTTPS.
  2. Configuring Monitoring Metrics: Configure monitoring metrics for a cluster or a node in the cluster.
  3. Viewing Cluster Monitoring Information: View the statistics of the monitoring metrics in specific periods.

Recommended Monitoring Metrics

Cluster CPU and JVM usage. You are advised to configure the following monitoring metrics: average JVM heap usage, maximum JVM heap usage, average CPU usage, and maximum CPU usage.

Prerequisites

  • The cluster is in the Available or Processing state.
  • The cluster has been running properly for more than 10 minutes.

Creating Alarm Rules

  1. Log in to the Cloud Eye console.
  2. In the navigation pane on the left, choose Alarm Management > Alarm Rules.
  3. In the Resource Type column, select Cloud Search Service to filter alarm rules.

    If no alarm rules are available, create some by referring to Creating an Alarm Rule. Table 1 and Table 2 describes the key parameters. For more parameters, customize them as needed.

    Table 1 Alarm rule configuration (clusters and cluster nodes)

    Parameter

    Description

    Alarm Type

    Select Metric.

    Cloud Service

    Select Cloud Search Service.

    Resource Layer

    Select the layer by which you are going to configure alarm rules.

    • CSS Clusters: Configure alarm rules by cluster.
    • CSS Clusters - CSS Instances: Configure alarm rules by cluster node.
    Table 2 Alarm rule configuration (Logstash pipelines)

    Parameter

    Description

    Alarm Type

    Select Metric.

    Cloud Service

    Select CSS.CUSTOM.

    Resource Layer

    Select the layer by which you are going to configure alarm rules.

    • cluster_id,instance_id,pipeline_name: Configure alarm rules by Logstash pipeline name of CSS cluster nodes.
    • cluster_id,pipeline_name: Configure alarm rules by Logstash pipeline name of CSS clusters.

Configuring Monitoring Metrics

  1. Create a monitoring panel by referring to Creating a Dashboard. If an available monitoring panel has been created, skip this step.
  2. Add CSS monitoring graphs by referring to Adding a Graph.

Viewing Cluster Monitoring Information

In the cluster list, check the monitoring information of clusters and cluster nodes.

  1. Log in to the CSS management console.
  2. In the navigation pane on the left, choose Clusters, and click a cluster type to go to the cluster list.
  3. In the cluster list, select a cluster and click View Metric in the Operation column to check the metrics of the cluster and cluster nodes.
    Figure 1 Viewing metrics
    • Click the Instances tab to check cluster metrics.
      • Instances: Select a cluster to check its metrics. The current cluster is selected by default. Multiple clusters can be selected so that you may compare between them.
      • You can also set monitoring periods so that you can compare metrics between different periods for the same cluster.
      • Add Graph Group: You can add a custom group in addition to the default group. When you move the pointer over a group name on the left, the icons for changing the group name and deleting the group are displayed on the right. You can modify the group.
      • Select Metric: In the displayed Select Metric dialog box, set All Metrics and Top N Metrics.
    • Click the CSS Instances tab to check the metrics of cluster nodes. Only the node monitoring information of the first cluster selected on the Instances tab is displayed.
      • CSS Instances: Select the cluster nodes whose metrics and information you want to check. By default, the first node of the current cluster is selected. Multiple nodes can be selected so that you may compare between them.
      • You can also set monitoring periods so that you can compare metrics between different periods for the same cluster.
      • Add Graph Group: You can add a custom group in addition to the default group. When you move the pointer over a group name on the left, the icons for changing the group name and deleting the group are displayed on the right. You can modify the group.
      • Select Metric: In the displayed Select Metric dialog box, set All Metrics.

We use cookies to improve our site and your experience. By continuing to browse our site you accept our cookie policy. Find out more

Feedback

Feedback

Feedback

0/500

Selected Content

Submit selected content with the feedback