SQL Execution Monitoring

SQL Monitoring Data

SQL monitoring data records various resource usage details of the query job (including memory, disk spills, CN and DN durations, OBS access time, and LakeFormation access time) and SQL execution plan information (EXPLAIN/EXPLAIN PERFORMANCE).

The fields displayed in the SQL monitoring data are as follows:

**Table 1** Fields displayed in SQL monitoring data
Field Name	Subfield Name	Type	Description
session_id	-	text	Session ID of a statement.
statement_id	-	text	Statement ID.
start_time	-	timestampt with zone	Start time of a statement.
finish_time	-	timestampt with zone	Reported/End time of a statement.
duration	-	bigint	Statement running duration. Unit: ms.
cn_actor_info	-	text	Serverless information of a CN.
	actor_name	text	Name of the pod where a CN is.
	actor_ip	text	IP address of the pod where a CN is.
	actor_id	text	Name of a CN within a pod.
dn_actor_info	-	text	Serverless information of a DN.
	actor_name	text	Name of the pod where a DN is.
	actor_ip	text	ID of the pod where a DN is.
	actor_id	text	Name of a DN within a pod.
startup_coordinator_duration	-	bigint	Duration to start a CN. Unit: ms.
create_session_duration	-	bigint	Duration to create a session. Unit: ms.
enqueue_statement_duration	-	bigint	Duration to add a statement to a task queue. Unit: ms.
queue_duration	-	bigint	Queuing duration of a statement in a task queue. Unit: ms.
write_resultset_duration	-	bigint	Duration to write a statement to a result set. Unit: ms.
queryid	-	bigint	ID of a debug query.
status	-	text	Statement status.
abort_info	-	text	Error message.
schemaname	-	text	Schema name when a statement is executed.
query	-	text	Statement.
query_plan	-	text	Explain information when GUC parameter resource_track_level is set to query. Explain performance information when set to perf.
pid	-	bigint	Thread ID.
parse_time	-	bigint	Time from parsing to execution start. Unit: ms.
estimate_memory	-	int	Estimated memory of a statement. Unit: MB.
dn_time	-	text	DN duration information.
	min_dn_time	bigint	Minimum DN duration. Unit: ms.
	max_dn_time	bigint	Maximum DN duration. Unit: ms.
	average_dn_time	bigint	Average DN duration. Unit: ms.
	dntime_skew_percent	int	Skew percentage of DN duration. Unit: %.
dn_cpu_time	-	text	DN CPU duration.
	min_cpu_time	bigint	Minimum DN CPU duration. Unit: ms.
	max_cpu_time	bigint	Maximum DN CPU duration. Unit: ms.
	average_cpu_time	bigint	Average DN CPU duration. Unit: ms.
	total_cpu_time	bigint	Total DN CPU duration. Unit: ms.
	cpu_skew_percent	int	Skew percentage of DN CPU duration. Unit: %.
dn_peak_memory	-	text	DN peak memory information.
	min_peak_memory	int	Minimum peak memory of all DNs. Unit: MB.
	max_peak_memory	int	Maximum peak memory of all DNs. Unit: MB.
	average_peak_memory	int	Average peak memory of all DNs. Unit: MB.
	memory_skew_percent	int	Memory skew rate. Unit: %.
dn_spill_info	-	text	DN disk spill information.
	spill_info	text	Number of DNs with disk spills.
	min_spill_size	bigint	Maximum spill size. Unit: MB.
	max_spill_size	bigint	Minimum spill size. Unit: MB.
	average_spill_size	bigint	Average spill size. Unit: MB.
	spill_skew_percent	int	Spill skew rate. Unit: %.
previous_billed_bytes	-	bigint	Original billing scan volume. Unit: byte.
disk_cache_info	-	text	Cache information.
	disk_cache_hit_ratio	numeric	Disk cache hit rate.
	disk_cache_disk_read_size	bigint	Read size of disk cache. Unit: byte.
	disk_cache_disk_write_size	bigint	Write size of disk cache. Unit: byte.
	disk_cache_remote_read_size	bigint	Remote read size of disk cache. Unit: byte.
	disk_cache_remote_read_time	bigint	Count of remote reads from disk cache. Unit: times.
obs_info	-	text	OBS information.
	vfs_scan_bytes	bigint	Bytes scanned by the OBS v file system. Unit: byte.
	vfs_remote_read_bytes	bigint	Bytes remotely read by the OBS v file system. Unit: byte.
	preload_submit_time	bigint	Commit time of pre-loading. Unit: μs.
	preload_wait_time	bigint	Wait time of pre-loading. Unit: μs.
	preload_wait_count	bigint	Count of pre-loading waits. Unit: times.
	disk_cache_load_time	bigint	Local load time of disk cache. Unit: μs.
	disk_cache_conflict_count	bigint	Hash collision count of disk cache blocks. Unit: times.
	disk_cache_error_count	bigint	Error count of disk cache. Unit: times.
	disk_cache_error_code	bigint	Error code of disk cache.
	obs_io_req_avg_rtt	bigint	Average round-trip time of OBS I/O requests. Unit: μs.
	obs_io_req_avg_latency	bigint	Average latency of OBS I/O requests. Unit: μs.
	obs_io_req_latency_gt_1s	bigint	Count of OBS I/O request delays exceeding 1s. Unit: times.
	obs_io_req_latency_gt_10s	bigint	Count of OBS I/O request delays exceeding 10s. Unit: times.
	obs_io_req_count	bigint	Number of OBS I/O requests. Unit: times.
	obs_io_req_count	bigint	Number of OBS I/O request retries. Unit: times.
	obs_io_req_rate_limit_count	bigint	Rate limit count of OBS I/O requests. Unit: times.

Current SQL monitoring data is stored in the OBS bucket of the result set, in the same directory as the result set folder. It can be accessed through the OBS service on the Huawei Cloud website. Based on the path of the current query's result set, locate the corresponding SQL monitoring data file in the same directory and download it for viewing. Upon opening the SQL monitoring data file, the following information is displayed:

Click to enlarge