Help Center> SecMaster> User Guide> Settings> Data Collection> Data Collection Overview
Updated on 2024-03-14 GMT+08:00
View PDF

Data Collection Overview

Data collection refers to the process of using Logstash to collect varied log data in many methods. After data is collected, historical data analysis and comparison, data association analysis, and unknown threat discovery can be quickly implemented.

Limitations and Constraints

  • Currently, the data collection agent can run only on Linux ECSs on x86_64 architecture. ECSs support the following OSs: Huawei Cloud EulerOS 2.5, Huawei Cloud EulerOS 2.9, EulerOS 2.5, EulerOS 2.9, and CentOS 7.9.
  • If you want to view information in the console during Agent installation, logging in as an IAM user is mandatory.

Collector Specifications

In collection management, the collector specifications are as follows:

Table 1 Collector Specifications

Specifications

Referenced Processing Capability

4U8G50G100G

2000 EPS @ 1KB

8U16G50G100G

5000 EPS @ 1KB

16U32G50G100G

10000 EPS @ 1KB

Log Source Limit

You can add as many as log sources you need to the collectors as long as your cloud resources can accommodate those logs. You can scale cloud resources anytime to meet your needs.

Parent topic: Data Collection