Help Center/ Cloud Transformation/ Serverless Real-Time Log Analysis/ Solution Overview
Updated on 2023-04-25 GMT+08:00
View PDF
Share

Solution Overview

Scenarios

This solution helps you collect, analyze, and archive Elastic Cloud Server (ECS) logs with a serverless architecture. It uses Log Tank Service (LTS) to collect ECS logs, FunctionGraph LTS trigger to obtain logs and analyze alarms in logs, Simple Message Notification (SMN) to push alarms to users, and Object Storage Service (OBS) to archive alarms.

Solution Architecture

This solution uses LTS to collect ECS logs, FunctionGraph LTS trigger to obtain logs and analyze alarms in logs, SMN to push alarms, and OBS to archive alarms. This solution architecture is illustrated below.
Figure 1 Architecture

This solution will:

  • Create an OBS bucket to store alarm logs.
  • Create a FunctionGraph function.
  • Create an SMN topic to push alarms in logs.
  • Create an LTS log group and log stream to manage collected logs.

Advantages

  • Serverless architecture

    LTS collects ECS logs, FunctionGraph analyzes and dumps logs, and SMN pushes alarms.

  • Customization based on open source

    This solution is open-source and free for commercial use. You can also make custom development based on source code.

  • Easy deployment

    You can deploy a real-time log analysis system in just a few clicks.

Constraints

  • Before deploying this solution, ensure that you have an account with access to the target region and sufficient balance for purchasing the resources listed in Table 1.
  • Ensure that OBS buckets are empty before deleting them.