Updated on 2024-10-30 GMT+08:00

Log Analysis (New)

AOM is a unified platform for observability analysis. It does not provide log functions by itself. Instead, it integrates the log management, ingestion, job, and transfer functions of Log Tank Service (LTS). You can perform operations on the AOM 2.0 or LTS console.

Before using the log management, ingestion, transfer, and job functions on the AOM 2.0 console, you need to purchase LTS resources first.

  • Log Analysis (new) is available only in the CN North-Beijing1, CN North-Beijing4, AP-Singapore, AF-Johannesburg, LA-Santiago, LA-Sao Paulo1, LA-Mexico City1, LA-Mexico City2, AP-Jakarta, TR-Istanbul, ME-Riyadh, CN East-Qingdao, CN East-Shanghai2, CN South-Guangzhou, CN North-Beijing2, CN-Hong Kong, AP-Bangkok, and CN East2 regions.
  • To use LTS functions on the AOM console, you need to obtain LTS permissions in advance. For details, see Permissions.
Table 1 Function description

Function

Description

AOM 2.0 Console

LTS Console

References

Log management

The overview page provides the following:

  • Log management

    Provides Statistics, Log Applications, My Favorites/My Favorites (Local Cache), Recently Visited, Alarms, Latest Alarms, Notices, and FAQs.

  • Log search and analysis

    Enables you to quickly query logs, and locate faults based on log sources and contexts.

  • Log applications

    LTS supports access to standard logs of multiple cloud services and provides out-of-the-box dashboard templates for the logs. After the logs are ingested, you can quickly analyze them.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Management.
  1. Log in to the LTS console.
  2. In the navigation pane, choose Log Management.

Log ingestion

Logs can be ingested through ICAgents, cloud services, APIs, and SDKs. After logs are ingested, they are displayed in a simple and orderly manner on the console and can be queried easily.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Ingestion.
  1. Log in to the LTS console.
  2. In the navigation pane, choose Log Ingestion.

Log Ingestion

Log transfer

After the log data of hosts and cloud services is reported to AOM or LTS, you can set the storage period as required. Log data that exceeds the storage period will be automatically deleted. You can transfer logs to other cloud services for long-term storage.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Transfer.
  1. Log in to the LTS console.
  2. In the navigation pane, choose Log Transfer.

Log Transfer

Log jobs

Provides SQL scheduled jobs, function processing, and metric generation.

  • SQL scheduled jobs

    Used to periodically analyze log content. These jobs use standard SQL syntax. They periodically perform log analysis based on scheduling rules, and store analysis results to a target log stream. Only whitelisted users can use this function by submitting a service ticket.

  • Function processing

    Normalizes, transfers, anonymizes, and filters logs based on provided function templates or custom functions. This function is available in the CN North-Beijing1, CN North-Beijing4, AP-Singapore, AF-Johannesburg, CN East-Shanghai1, LA-Santiago, LA-Sao Paulo1, LA-Mexico City1, LA-Mexico City2, AP-Jakarta, and TR-Istanbul.

  • Metric generation

    You can create log metric rules to extract log data reported to LTS as metrics and monitor them on the metric browsing and dashboard pages. Only whitelisted users can use this function by submitting a service ticket.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Jobs.
  1. Log in to the LTS console.
  2. In the navigation pane, choose Log Jobs.

Log Processing

Log Analysis (Old)

Log analysis (old) provides log search, log files, log paths, log dumps, and LTS access. You can click Back to Old Version to use log functions of the old version.

Table 2 Function description

Function

Description

AOM 2.0 Console

References

Log search

AOM enables you to quickly query logs, and locate faults based on log sources and contexts.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Management.
  3. Click Back to Old Version in the upper right corner of the page. The Log Search tab page is displayed.

Searching for Logs

Log files

You can quickly check log files of component instances or hosts to locate faults.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Management.
  3. Click Back to Old Version in the upper right corner of the page. The Log Search tab page is displayed.
  4. Click the Log Files tab.

Checking Log Files

Log paths

AOM can collect and display VM logs. A VM refers to an Elastic Cloud Server (ECS) running Linux. Before collecting logs, ensure that you have set a log collection path.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Management.
  3. Click Back to Old Version in the upper right corner of the page. The Log Search tab page is displayed.
  4. Click the Log Paths tab.

Configuring VM Log Collection Paths

Log transfer

AOM enables you to dump logs to Object Storage Service (OBS) buckets for long-term storage. To store logs for a longer time, add log dumps.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > Log Management.
  3. Click Back to Old Version in the upper right corner of the page. The Log Search tab page is displayed.
  4. Click the Log Transfer tab.

Adding Log Dumps

LTS access

LTS is a unified log management platform that allows you to search for, structure, and view logs. By adding access rules, you can map logs of CCE or custom clusters in AOM to LTS. Then you can view and analyze logs on LTS. Mapping does not generate extra fees, but duplicate mapping will.

  1. Log in to the AOM 2.0 console.
  2. In the navigation pane, choose Log Analysis > LTS Access.

LTS Access