Updated on 2024-09-19 GMT+08:00

Overview

Logs reported from hosts and cloud services are retained in LTS for 30 days by default. You can set the retention period to 1 to 365 days. Retained logs are deleted once the retention period is over. For long-term retention, you can transfer logs to other cloud services.

Log transfer refers to when logs are replicated to other cloud services. LTS deletes retained logs once the retention period is over, but the logs that have been transferred to other services are not affected.

Currently, LTS allows you to transfer logs to the following services. Select services as required.

Table 1 Transfer destination services

Service

Scenario

OBS

OBS provides mass, secure, and cost-effective data storage for you to store data of any type and size. It is suitable for various scenarios, such as enterprise-level backup/archiving, video on demand (VoD), and video monitoring.

OBS offers the following storage classes: Standard, Infrequent Access, Archive, and Deep Archive (under restricted OBT), to meet different requirements for storage performance and cost.

DMS for Kafka

DMS for Kafka is a message queuing service using open-source Apache Kafka. It features highly reliable, asynchronous message delivery, and provides Kafka instances with isolated computing, storage, and bandwidth resources.

It is widely used for transmitting data between different systems in many industries, including enterprise application, payment, telecommunications, e-commerce, social networking, instant messaging, video, Internet of Things (IoT), and Internet of Vehicle (IoV).

Kafka can handle the transmission of massive logs. Applications asynchronously send log messages to message queues. Other components can read the log messages from message queues for further analysis, either in real time or offline. In addition, Kafka can collect key log information to monitor applications.

DIS

Data Ingestion Service (DIS) addresses the challenge of transmitting data from outside the cloud to inside the cloud. It builds data streams for custom applications capable of processing or analyzing streaming data. DIS continuously captures, transmits, and stores terabytes of data from hundreds of thousands of data sources every hour, such as IoT data collection, logs, location-tracking events, website clickstreams, and social media.

GaussDB(DWS)

GaussDB(DWS) is a fully-managed, enterprise-level cloud data warehouse service. It boasts high performance, low cost, and smooth scale-out, helping enterprise data warehouses handle the growing data volumes at ease. It is applicable to scenarios such as storage and analysis of massive logs.

DLI

Data Lake Insight (DLI) is a serverless big data compute and analysis service that is fully compatible with Apache Spark, Apache Flink, and Trino. It provides streaming, batch, and interactive data processing.

It is applicable to scenarios requiring massive log analysis and big data processing. For example, different departments of a game company analyze daily new logs via a game data analysis platform to obtain required metrics and make decision based on the obtained metric data.