Flink Source and Sink Operator Metrics

Scenarios

Flink provides metrics to help analyze job performance. This feature adds Source and Sink operator metrics to the monitoring system. This feature is enabled by default and requires no configuration. You can view the data sent and received by the Source and Sink operators on the native Flink web UI.

Notes and Constraints

This section applies to MRS 3.6.0-LTS.1 and later.

Procedure

1. After the job starts, click Job Monitoring in the Operation column to open the native Flink web UI.
2. On the Running Jobs page, click the job name to view the metrics for the Source and Sink operators. For example:
   • 0.Source__datagen[1].source.numRecordsIn/numRecordsInPerSecond/numRecordsOut/numRecordsOutPerSecond: The total number of records received or sent by the Source operator and the rate (records per second).
   • 0.Sink__fs_table[3].sink.numRecordsIn/numRecordsInPerSecond/numRecordsOut/numRecordsOutPerSecond: The total number of records received or sent by the Sink operator and the rate (records per second).