Help Center/ Log Tank Service/ User Guide/ Log Visualization/ Visualizing Logs in Dashboards/ Dashboard Templates (Pipe Character)/ LTS Dashboard Templates
Updated on 2026-05-12 GMT+08:00
View PDF
Share

LTS Dashboard Templates

LTS dashboard templates include the following dashboards:

  • Metric Generation Task Monitoring Center: generates statistics reports based on the metric rules defined on the LTS console. You can configure single or combined filters (using associations and groups) to retain desired logs. Statistics for structured logs within a specified time range are dynamically collected and displayed on AOM Prometheus instances, providing a powerful and user-friendly visualization experience.
  • OBS Import Task Dashboard: monitors log import tasks from OBS to LTS, providing visibility into task IDs, names, success/failure counts, and processing rates. This dashboard allows you to track data import status in real time and quickly locate exceptions, ensuring efficient and complete data import.
  • Resource Usage Details: This dashboard requires LTS Observability to be enabled. For details, see Setting LTS Log Collection Quota and Usage Alarms. You can filter resource usage details (such as raw log traffic, index traffic, and storage) of log streams by time range, log group ID, or log stream ID. This helps you monitor resource consumption, detect traffic anomalies, and optimize resource configurations to improve resource utilization.
  • Top Usage: This dashboard requires LTS Observability to be enabled. For details, see Setting LTS Log Collection Quota and Usage Alarms. It displays the resource usage of top N log groups or streams, including raw log traffic, index traffic, and storage. You can filter data by time range, log group ID, or log stream ID. It helps you spot high resource consumption, detect abnormal traffic, and optimize log collection policies and resource configurations to cut unnecessary costs.
  • DSL Processing Task Monitoring Center: LTS provides DSL for one-stop log processing. With domain-defined script languages and more than 200 built-in functions, you can perform E2E log processing tasks directly on the LTS console, including normalization, enrichment, transfer, anonymization, and filtering. This dashboard displays task details, such as task IDs, task names, and input/output line counts.

Before using the OBS Import Task, Resource Usage Details, and Top Usage dashboards, you must enable the pipe character search mode. To enable this search mode, submit a service ticket.

Metric Generation Task Monitoring Center

  1. Log in to the LTS console.
  2. In the navigation pane, choose Dashboards.
  3. Choose LTS Dashboard Templates under Dashboard Templates and click Metric Generation Task Monitoring Center to view the detailed charts.

    Figure 1 Metric Generation Task Monitoring Center
    • Filter by rule ID. The associated query and analysis statement is: 
      * | SELECT distinct(task_set)
    • Input Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "input" < 1000 THEN concat( cast( "input" AS VARCHAR ), '' )  WHEN "input" < 1000 * 1000 THEN concat( cast( round( "input"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "input" < 1000000000.0 THEN concat( cast( round( "input"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "input"/ 1000.0 < 1000000000.0 THEN concat( cast( round( "input"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "input"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("input") as "input")
    • Output Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "output" < 1000 THEN concat( cast( "output" AS VARCHAR ), '' )  WHEN "output" < 1000 * 1000 THEN concat( cast( round( "output"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "output" < 1000000000 THEN concat( cast( round( "output"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN \"output\"/ 1000.0 < 1000000000 THEN concat( cast( round( "output"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "output"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("output") as "output")
    • Filter Criteria Met. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "filters" < 1000 THEN concat( cast( "filters" AS VARCHAR ), '' )  WHEN "filters" < 1000 * 1000 THEN concat( cast( round( "filters"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "filters" < 1000000000 THEN concat( cast( round( "filters"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "filters"/ 1000.0 < 1000000000 THEN concat( cast( round( "filters"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "filters"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("filters") as "filters")
    • Filter Criteria Unmet. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "filter_drops" < 1000 THEN concat( cast( "filter_drops" AS VARCHAR ), '' )  WHEN "filter_drops" < 1000 * 1000 THEN concat( cast( round( "filter_drops"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "filter_drops" < 1000000000 THEN concat( cast( round( "filter_drops"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "filter_drops"/ 1000.0 < 1000000000 THEN concat( cast( round( "filter_drops"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "filter_drops"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("filter_drops") as "filter_drops")
    • Sampled Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "samples" < 1000 THEN concat( cast( "samples" AS VARCHAR ), '' )  WHEN "samples" < 1000 * 1000 THEN concat( cast( round( "samples"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "samples" < 1000000000 THEN concat( cast( round( "samples"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "samples"/ 1000.0 < 1000000000 THEN concat( cast( round( "samples"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "samples"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("samples") as "samples")
    • Unsampled Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "sample_drops" < 1000 THEN concat( cast( "sample_drops" AS VARCHAR ), '' )  WHEN "sample_drops" < 1000 * 1000 THEN concat( cast( round( "sample_drops"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "sample_drops" < 1000000000 THEN concat( cast( round( "sample_drops"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "sample_drops"/ 1000.0 < 1000000000 THEN concat( cast( round( "sample_drops"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "sample_drops"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum( "sample_drops" ) as "sample_drops")
    • Lines Exceeding Log Time Range. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "out_of_bound" < 1000 THEN concat( cast( "out_of_bounds" AS VARCHAR ), '' )  WHEN "out_of_bounds" < 1000 * 1000 THEN concat( cast( round( "out_of_bounds"/ 1000.0, 1 ) AS VARCHAR ), ' thousand' ) WHEN "out_of_bounds" < 1000000000 THEN concat( cast( round( "out_of_bounds"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "out_of_bounds"/ 1000.0 < 1000000000 THEN concat( cast( round( "out_of_bounds"/ 1000.0 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "out_of_bounds"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("out_of_bounds") as "out_of_bounds")
    • Execution Records. The associated query and analysis statement is: 
      * | SELECT from_unixtime( "__time") as "Log Time", sum("input") as "Input Lines",sum("output") as "Output Lines",sum("filters") as "Filter Criteria Met",sum("filter_drops") as "Filter Criteria Unmet",sum("samples") as "Sampled Lines",sum("sample_drops") as "Unsampled Lines",sum("out_of_bounds") as "Lines Exceeding Log Time Range" group by "Log Time" order by "Log Time" desc limit 1000

OBS Import Task Dashboard

  1. Choose LTS Dashboard Templates under Dashboard Templates and click OBS Import Task Dashboard to view the detailed charts.

    Figure 2 OBS Import Task Dashboard
    • Filter by task ID. The associated query and analysis statement is: 
      * | SELECT task_set_id group by task_set_id
    • Filter by task name. The associated query and analysis statement is: 
      * | SELECT task_set_name group by task_set_name
    • Successful Logs. The associated query and analysis statement is: 
      * | SELECT sum(max_read_line) as "Successful Logs" from (select max_by(read_lines,__time) as max_read_line group by task_set_id,period_times limit 10000)
    • Failed Logs. The associated query and analysis statement is: 
      * | SELECT sum(max_failure_lines) as "Failed Logs" from (select max_by(failure_lines,__time) as max_failure_lines group by task_set_id,period_times limit 10000)
    • Discarded Records. The associated query and analysis statement is: 
      * | SELECT sum(max_ignore_lines) as "Discarded Records" from (select max_by(ignore_lines,__time) as max_ignore_lines group by task_set_id,period_times limit 10000)
    • Read Traffic. The associated query and analysis statement is: 
      * | SELECT sum(max_in_flow)/1024.0/1024 as "Read Traffic" from (select max_by(in_flow,__time) as max_in_flow group by task_set_id,period_times limit 10000)
    • Write Traffic. The associated query and analysis statement is: 
      * | SELECT sum(max_out_flow)/1024.0/1024 as "Write Traffic" from (select max_by(out_flow,__time) as max_out_flow group by task_set_id,period_times limit 10000)
    • Import Progress. The associated query and analysis statement is: 
      * | SELECT max_by(case when total_files = 0 or total_files is null then 'NA' else cast(complete_files*1.0/total_files*100 as VARCHAR) end ,__time ) as progress
    • Processing Rate. The associated query and analysis statement is: 
      * | SELECT t AS "Time interval", ROUND((  CASE WHEN diff [ 1 ] IS NOT NULL    AND diff [ 2 ] IS NOT NULL AND diff [ 1 ] - diff [ 2 ] > 0 THEN     diff [ 1 ] - diff [ 2 ]     WHEN diff [ 1 ] IS NOT NULL     AND diff [ 2 ] IS NULL THEN diff [ 1 ] ELSE 0     END     ) / 300,0) AS "Successful logs/s"    FROM     (     SELECT t, ts_compare ( max_read_lines, 300 ) AS diff     FROM ( SELECT t, sum( max_read_lines ) AS max_read_lines FROM ( SELECT from_unixtime( __time - __time % 300000 ) AS t, max_by ( read_lines, __time ) AS max_read_lines, task_set_id, period_times GROUP BY t, task_set_id, period_times LIMIT 10000 ) GROUP BY t ORDER BY t )     GROUP BY t     ORDER BY t     LIMIT 10000  ) LIMIT 10000
    • Task Exceptions. The associated query and analysis statement is: 
      * | SELECT  task_set_name as "Task Name",task_set_id as "Task ID" , max_by(task_set_state,__time ) as "Task Status" , from_unixtime(max(__time)) as "Collected" , max_by(failure_lines,__time) as "Failed Logs"  group by task_set_id,task_set_name HAVING "Failed Logs" = 'UNHEALTHY' OR "Task Status" = 'FAILURE' limit 10000
    • Running Status. The associated query and analysis statement is: 
      * | SELECT task_set_name as "Task Name",task_set_id as "Task ID" , max_by(task_set_state,__time ) as "Task Status" , max_by(read_lines,__time)  as "Successful Logs" ,max_by(failure_lines,__time) as "Failed Logs" , max_by(in_flow,__time)/1024/1024 as "Read Traffic (MB)" , max_by(out_flow,__time)/1024/1024 as "Write Traffic (MB)",period_times as "Period" group by task_set_id,task_set_name,period_times order by max(__time),task_set_id,period_times limit 10000

Resource Usage Details

  1. Choose LTS Dashboard Templates under Dashboard Templates and click Resource Usage Details to view the detailed charts.

    If some charts on the dashboard are not properly displayed, you can click Auto Configure on the Index Settings tab page to update index fields. For details, see Configuring Log Indexing. Then, return to the Dashboards page and check that the charts are displayed properly.

    Figure 3 Resource Usage Details
    • Filter by log group ID. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" | SELECT log_group_id from log group by log_group_id limit 100000
    • Filter by log group name. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" | SELECT log_group_name_alias from log group by log_group_name_alias limit 100000
    • Filter by log stream ID. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" | SELECT log_stream_id from log group by log_stream_id limit 100000
    • Filter by log stream name. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" | SELECT log_stream_name_alias from log group by log_stream_name_alias limit 100000
    • Raw Log Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"storage_traffic" | SELECT sum(counter)/1024/1024 as "Raw Log Traffic (MB)"
    • Read Traffic (Compressed; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"read" | SELECT sum(counter)/1024/1024/5 as "Read Traffic (MB)"
    • Write Traffic (Compressed; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"write_traffic" | SELECT sum(counter)/1024/1024 as "Write Traffic (MB)"
    • Index Traffic (Standard; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"index_traffic" | SELECT sum(counter)/1024/1024 as "Index Traffic (MB)"
    • Index Traffic (Search; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"search_index_traffic" | SELECT sum(counter)/1024/1024 as "Index Traffic (MB)"
    • DSL Processing Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"dsl_traffic" && counter:* | SELECT sum(counter)/1024/1024 as "DSL Processing Traffic (MB)"
    • Log-to-Metric Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"log2Metric" | select sum(counter)/1024/1024 as "Log-to-Metric Traffic (MB)"
    • Standard Storage Volume (Latest; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"storage" && counter:* | SELECT select sum(max_storage) as "Standard Storage Volume (Latest; MB)" from (select max_by(counter,__time)/1024/1024 as max_storage group by log_stream_id limit 10000 )
    • Cold Storage Volume (Latest; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"cold_storage" && counter:* | SELECT sum(max_cold_storage) as "Cold Storage Volume (Latest; MB)" from (select max_by(counter,__time)/1024/1024 as max_cold_storage group by log_stream_id limit 10000 )
    • Basic Transfer Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and (metric_name:"obs_transfer" or metric_name:"dms_transfer" or metric_name:"dis_transfer") | SELECT sum(counter)/1024.0/1024 as "Basic Transfer Traffic (MB)"
    • Advanced Transfer Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and (metric_name:"dws_transfer" or metric_name:"dli_transfer" or metric_name:"obs_orc_transfer") | SELECT sum(counter)/1024/1024 as "Advanced Transfer Traffic (MB)"
    • Raw Log Traffic. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"storage_traffic" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter/1024/1024) as "Raw log traffic (MB)" group by "Time" order by "Time" limit 10000
    • Read Traffic (Compressed). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"read" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Read traffic (MB)" group by "Time" order by "Time" limit 10000
    • Write Traffic (Compressed). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"write_traffic" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Write traffic (MB)" group by "Time" order by "Time" limit 10000
    • Index Traffic (Standard). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"index_traffic" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Index traffic (MB)" group by "Time" order by "Time" limit 10000
    • Index Traffic (Search). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"search_index_traffic" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Index traffic (MB)" group by "Time" order by "Time" limit 10000
    • DSL Processing Traffic. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"dsl_traffic" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "DSL processing traffic (MB)" group by "Time" order by "Time" limit 10000
    • Log-to-Metric Traffic. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"log2Metric" | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Log-to-metric traffic (MB)" group by "Time" order by "Time" limit 10000
    • Standard Storage Volume (Latest). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"storage"| SELECT from_unixtime(__time - __time%60000) as "Time",max_by(counter,__time)/1024/1024 as "Standard storage volume (latest; MB)" group by "Time" order by "Time" limit 10000
    • Cold Storage Volume (Latest). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"cold_storage" | SELECT from_unixtime(__time - __time%60000) as "Time",max_by(counter,__time)/1024/1024 as "Cold storage volume (latest; MB)" group by "Time" order by "Time" limit 10000
    • Basic Transfer Traffic. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and (metric_name:"obs_transfer" or metric_name:"dms_transfer" or metric_name:"dis_transfer") | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Basic transfer traffic (MB)" group by "Time" order by "Time" limit 10000
    • Advanced Transfer Traffic. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and (metric_name:"dws_transfer" or metric_name:"dli_transfer" or metric_name:"obs_orc_transfer") | SELECT from_unixtime(__time - __time%60000) as "Time",sum(counter)/1024/1024 as "Advanced transfer traffic (MB)" group by "Time" order by "Time" limit 10000

Top Usage

  1. Choose LTS Dashboard Templates under Dashboard Templates and click Top Usage to view the detailed charts.

    If some charts on the dashboard are not properly displayed, you can click Auto Configure on the Index Settings tab page to update index fields. For details, see Configuring Log Indexing. Then, return to the Dashboards page and check that the charts are displayed properly.

    Figure 4 Top Usage
    • Filter by log group ID. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*"  | SELECT log_group_id from log group by log_group_id limit 100000
    • Filter by log group name. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" | SELECT log_group_name_alias from log group by log_group_name_alias limit 100000
    • Filter by log stream ID. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*"  | SELECT log_stream_id from log group by log_stream_id limit 100000
    • Filter by log stream name. The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" | SELECT log_stream_name_alias from log group by log_stream_name_alias limit 100000
    • Raw Log Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"storage_traffic" | SELECT sum(counter)/1024/1024 as "Raw Log Traffic (MB)"
    • Read Traffic (Compressed; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"read" | SELECT sum(counter)/1024/1024 as "Read Traffic (MB)"
    • Write Traffic (Compressed; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"write_traffic" | SELECT sum(counter)/1024/1024 as "Write Traffic (MB)"
    • Index Traffic (Standard; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"index_traffic" | SELECT sum(counter)/1024/1024 as "Index Traffic (MB)"
    • Index Traffic (Search; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"search_index_traffic" | SELECT sum(counter)/1024/1024 as "Index Traffic (MB)"
    • DSL Processing Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"dsl_traffic" && counter:* | SELECT sum(counter)/1024/1024 as "DSL Processing Traffic (MB)"
    • Log-to-Metric Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"log2Metric" | SELECT sum(counter)/1024/1024 as "Log-to-Metric Traffic (MB)"
    • Standard Storage Volume (Latest; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"storage" && counter:* | SELECT sum(max_storage) as "Standard Storage Volume (Latest; MB)" from (select max_by(counter,__time)/1024/1024 as max_storage group by log_stream_id limit 10000 )
    • Cold Storage Volume (Latest; MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and metric_name:"cold_storage" && counter:* | SELECT sum(max_cold_storage) as "Cold Storage Volume (Latest; MB)" from (select max_by(counter,__time)/1024/1024 as max_cold_storage group by log_stream_id limit 10000 )
    • Basic Transfer Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and (metric_name:"obs_transfer" or metric_name:"dms_transfer" or metric_name:"dis_transfer") | SELECT sum(counter)/1024/1024 as "Basic Transfer Traffic (MB)"
    • Advanced Transfer Traffic (MB). The associated query and analysis statement is: 
      not log_group_id:"__default__*" and not log_group_name_alias:"__default__*" and (metric_name:"dws_transfer" or metric_name:"dli_transfer" or metric_name:"obs_orc_transfer") | SELECT sum(counter)/1024/1024 as "Advanced Transfer Traffic (MB)"
    • Log Groups by Resource Usage. The associated query and analysis statement is: 
      not log_group_id:"__default__*"  | SELECT  log_group_id as "Log Group ID", sum(case when metric_name = 'storage_traffic' then counter else 0 end)*1.0/1024/1024 as "Raw Log Traffic (MB)", sum(case when metric_name = 'index_traffic' then counter else 0 end)*1.0/1024/1024 as "Index Traffic (Standard; MB)", sum(case when metric_name = 'search_index_traffic' then counter else 0 end)*1.0/1024/1024 as "Index Traffic (Search; MB)", sum(case when metric_name = 'write_traffic' then counter else 0 end)*1.0/1024/1024 as "Write Traffic (Compressed; MB)", sum(case when metric_name = 'storage' then counter else 0 end)*1.0/1024/1024 as "Standard Storage Volume (Latest; MB)", sum(case when metric_name = 'cold_storage' then counter else 0 end)*1.0/1024/1024 as "Cold Storage Volume (Latest; MB)" group by log_group_id order by "Raw Log Traffic (MB)" desc
    • Log Streams by Resource Usage. The associated query and analysis statement is: 
      not log_group_id:"__default__*"  | SELECT  log_stream_id as "Log Stream ID", sum(case when metric_name = 'storage_traffic' then counter else 0 end)*1.0/1024/1024 as "Raw Log Traffic (MB)", sum(case when metric_name = 'index_traffic' then counter else 0 end)*1.0/1024/1024 as "Index Traffic (Standard; MB)", sum(case when metric_name = 'search_index_traffic' then counter else 0 end)*1.0/1024/1024 as "Index Traffic (Search; MB)", sum(case when metric_name = 'write_traffic' then counter else 0 end)*1.0/1024/1024 as "Write Traffic (Compressed; MB)",sum(case when metric_name = 'storage' then counter else 0 end)*1.0/1024/1024 as "Standard Storage Volume (Latest; MB)",sum(case when metric_name = 'cold_storage' then counter else 0 end)*1.0/1024/1024 as "Cold Storage Volume (Latest; MB)" group by log_stream_id order by "Raw Log Traffic (MB)" desc

DSL Processing Task Monitoring Center

  1. Choose LTS Dashboard Templates under Dashboard Templates and click DSL Processing Task Monitoring Center to view the detailed charts.

    Figure 5 DSL Processing Task Monitoring Center
    • Filter by processing task ID. The associated query and analysis statement is: 
      * | SELECT distinct(task_id)
    • Filter by processing task name. The associated query and analysis statement is: 
      * | SELECT distinct(task_name)
    • Input Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "input" < 1000 THEN concat( cast( "input" AS VARCHAR ), '' )  WHEN "input" < 1000 * 1000 THEN concat( cast( round( "input"/ 1000, 1 ) AS VARCHAR ), ' thousand' ) WHEN "input" < 1000000000 THEN concat( cast( round( "input"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "input"/ 1000.0 < 1000000000 THEN concat( cast( round( "input"/ 1000 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "input"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("process.accept") as "input")
    • Output Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "delivered" < 1000 THEN concat( cast( "delivered" AS VARCHAR ), '' )  WHEN "delivered" < 1000 * 1000 THEN concat( cast( round( "delivered"/ 1000, 1 ) AS VARCHAR ), ' thousand' ) WHEN "delivered" < 1000000000 THEN concat( cast( round( "delivered"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "delivered"/ 1000.0 < 1000000000 THEN concat( cast( round( "delivered"/ 1000 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "delivered"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("process.delivered") as "delivered")
    • Filtered Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "drop" < 1000 THEN concat( cast( "drop" AS VARCHAR ), '' )  WHEN "drop" < 1000 * 1000 THEN concat( cast( round( "drop"/ 1000, 1 ) AS VARCHAR ), ' thousand' ) WHEN "drop" < 1000000000 THEN concat( cast( round( "drop"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "drop"/ 1000.0 < 1000000000 THEN concat( cast( round( "drop"/ 1000 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "drop"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("process.drop") as \"drop\")
    • Failed Lines. The associated query and analysis statement is: 
      * | SELECT CASE   WHEN  "failed" < 1000 THEN concat( cast( "failed" AS VARCHAR ), '' )  WHEN "failed" < 1000 * 1000 THEN concat( cast( round( "failed"/ 1000, 1 ) AS VARCHAR ), ' thousand' ) WHEN "failed" < 1000000000 THEN concat( cast( round( "failed"/ 1000000.0, 1 ) AS VARCHAR ), ' million' )  WHEN "failed"/ 1000.0 < 1000000000 THEN concat( cast( round( "failed"/ 1000 / 1000000.0, 1 ) AS VARCHAR ), ' billion' ) ELSE concat( cast( round( "failed"/ 1000.0 / 1000 / 1000 / 1000, 1 ) AS VARCHAR ), ' trillion' )  END AS  "total"  from (select sum("process.failed") as "failed")
    • Execution Records. The associated query and analysis statement is: 
      * | SELECT MILLIS_TO_TIMESTAMP("start") as "Started", MILLIS_TO_TIMESTAMP("end") as "Ended", "process.accept" as "Input Lines", "process.delivered" as "Output Lines", "process.drop" as "Filtered Lines", "process.failed" as "Failed Lines" limit 1000

Parent Topic: Dashboard Templates (Pipe Character)