Overview

Log ingestion is the process of collecting log data generated during the running of applications or services and storing the data to specified locations for subsequent analysis and use. This log data, which includes system running status, error information, and user operation records, is important for system O&M, troubleshooting, and service analysis.

LTS enables real-time log ingestion via various methods. Logs can be collected using ICAgent, ingested from cloud services, or reported to LTS via custom software or APIs. Subsequently, you can search and analyze these logs on the LTS console, visualize log statistics in charts or dashboards, and set alarm reporting and log transfer.

Before configuring log ingestion, ensure that ICAgent collection is enabled by referring to Setting LTS Log Collection Quota and Usage Alarms.

This function is enabled by default. If you do not need to collect logs, disable this function to reduce resource usage.
After this function is disabled, ICAgent will stop collecting logs, and the log collection function on the AOM console will also be disabled.

Data Sources

Table 1 lists the sources of logs that can be reported to LTS.

**Table 1** Data sources
Type	Source	Ingestion Method
Application	Program output	Ingesting CCE Application Logs to LTS
Application	Access logs	Ingesting WAF Logs to LTS
OS	Linux	Installing ICAgent (Intra-Region Hosts) Installing ICAgent (Extra-Region Hosts)
	Windows
	Docker files
	Docker output
Database	MySQL	Ingesting GaussDB(for MySQL) Logs to LTS Ingesting RDS for MySQL Logs to LTS
	SQL Server	Ingesting RDS for SQL Server Logs to LTS
	PostgreSQL	Ingesting RDS for PostgreSQL Logs to LTS
	GaussDB	Ingesting GaussDB(DWS) Logs to LTS
	GeminiDB	Ingesting GeminiDB Logs to LTS Ingesting GeminiDB Mongo Logs to LTS Ingesting GeminiDB Cassandra Logs to LTS
Standard protocol	HTTP polling	Using Kafka to Report Logs to LTS
	Syslog	Using Kafka to Report Logs to LTS
	Kafka	Using Kafka to Report Logs to LTS
Third party	Logstash	Using Kafka to Report Logs to LTS
	Flume	Using Kafka to Report Logs to LTS
	Beats	Using Kafka to Report Logs to LTS
Cloud service	Logs of Huawei Cloud services, such as ECS and CCE	Ingesting Cloud Service Logs to LTS