Solution Overview

Updated on 2023-04-25 GMT+08:00

View PDF

Scenarios

This solution helps you collect, analyze, and archive Elastic Cloud Server (ECS) logs with a serverless architecture. It uses Log Tank Service (LTS) to collect ECS logs, FunctionGraph LTS trigger to obtain logs and analyze alarms in logs, Simple Message Notification (SMN) to push alarms to users, and Object Storage Service (OBS) to archive alarms.

Solution Architecture

This solution uses LTS to collect ECS logs, FunctionGraph LTS trigger to obtain logs and analyze alarms in logs, SMN to push alarms, and OBS to archive alarms. This solution architecture is illustrated below.

Figure 1 Architecture

This solution will:

Create an OBS bucket to store alarm logs.
Create a FunctionGraph function.
Create an SMN topic to push alarms in logs.
Create an LTS log group and log stream to manage collected logs.

Advantages

Serverless architecture
LTS collects ECS logs, FunctionGraph analyzes and dumps logs, and SMN pushes alarms.

Customization based on open source
This solution is open-source and free for commercial use. You can also make custom development based on source code.

Easy deployment
You can deploy a real-time log analysis system in just a few clicks.

Constraints

Before deploying this solution, ensure that you have an account with access to the target region and sufficient balance for purchasing the resources listed in Table 1.
Ensure that OBS buckets are empty before deleting them.

Next topic: Resource and Cost Planning