Updated on 2024-06-26 GMT+08:00

Prometheus Agent View

Prometheus Agent is a lightweight version of Prometheus Server. It scrapes the metrics for all hosts and components. The metrics data is then reported to and stored on AOM or a third-party monitoring platform. The Prometheus Agent view displays some built-in metrics provided by Prometheus, which can be used to monitor and measure system performance and status.

Metric Description

You can view Prometheus Agent metrics in the following table.

Figure 1 Prometheus Agent metrics
Table 1 Prometheus Agent metrics

Metric

Unit

Description

CPU Usage

%

Average CPU usage of pods.

Memory Usage

%

Average memory usage of pods.

Remote Write Rate

byte/s

The number of bytes remotely written per second.

Average Remote Write Duration

second

Average time consumed by remote writes.

Bytes Pending for Remote Write

byte

The number of pending bytes during a remote write.

Packets Discarded for Remote Write per Second

N/A

The number of packets discarded per second during a remote write.

Failed Remote Write Requests per Second

N/A

The number of failed remote write requests per second.

Percentage of Failed Remote Write Requests

%

Percentage of failed remote write requests.

Remote Write Retries per Second

N/A

The number of retries of the remote write per second.

Scrapers

N/A

The number of scrapers.

Collections per Second

N/A

Collections per second.

Average Collection Duration

second

Average collection duration.

Failed Reads During Collection per Second

N/A

The number of read errors during scrapes per second.

Failed Writes During Collection per Second

N/A

The number of write errors during scrapes per second.

Collections with Size Exceeding the Threshold per Second

N/A

Collections with size exceeding the threshold per second.

Read Rate of Sending Queue

byte/s

The number of bytes read by a sending queue per second.

Write Rate of Sending Queue

byte/s

The number of bytes written to a sending queue per second.

Pending Size of Sending Queue

byte

The number of bytes suspended in a sending queue.

Blocks Read per Second

N/A

The number of blocks read by a sending queue per second.

Blocks Written per Second

N/A

The number of blocks written to a sending queue per second.

Discarded Blocks per Second

N/A

The number of dropped blocks in a sending queue per second.

Metric List

The following is the metric list of the Prometheus Agent view.
Table 2 Metric description

Metric

Type

Description

container_cpu_usage_seconds_total

Gauge

Cumulative CPU time consumed in seconds.

container_memory_working_set_bytes

Gauge

Current working set in bytes.

vmagent_remotewrite_bytes_sent_total

Counter

Total number of bytes remotely written by Prometheus Agent.

vmagent_remotewrite_duration_seconds_sum

Summary

Time consumed by a Prometheus Agent remote write.

vmagent_remotewrite_pending_data_bytes

Gauge

The number of pending bytes during a Prometheus Agent remote write.

vmagent_remotewrite_packets_dropped_total

Counter

Total number of dropped packets during a Prometheus Agent remote write.

vmagent_remotewrite_requests_total

Counter

Total number of Prometheus Agent remote write requests.

vmagent_remotewrite_retries_count_total

Counter

Total number of remote write retries of Prometheus Agent.

vm_promscrape_active_scrapers

Gauge

The number of collected shards.

vm_promscrape_scrapes_total

Counter

The number of scrapes.

vm_promscrape_scrape_duration_seconds_sum

Summary

Time required for the vmagent to collect metrics.

vm_promscrape_conn_read_errors_total

Counter

The number of read errors during scrapes.

vm_promscrape_conn_write_errors_total

Counter

The number of write errors during scrapes.

vm_promscrape_max_scrape_size_exceeded_errors_total

Counter

The number of failed scrapes due to the exceeded response size.

vm_persistentqueue_bytes_read_total

Counter

The number of bytes read by a send queue.

vm_persistentqueue_bytes_written_total

Counter

The number of bytes written to a send queue.

vm_persistentqueue_bytes_pending

Gauge

The number of pending bytes in a send queue.

vm_persistentqueue_blocks_read_total

Counter

The number of blocks read by a send queue.

vm_persistentqueue_blocks_written_total

Counter

The number of blocks written to a send queue.

vm_persistentqueue_blocks_dropped_total

Counter

The number of dropped blocks in a send queue.