DMS for Kafka接入
LTS支持分布式消息服务Kafka日志接入,具体接入方法请参见查看重平衡日志。
结构化模板日志详情
- DMS重平衡日志示例日志
表1 结构化模板示例 模板名称
示例日志
DMS重平衡日志
{ "level":"INFO", "timestamp":"2023-03-23 17:23:22,906", "message":{ "leaderId":"consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635", "generationId":"1","reason":"Assignment received from leader for group KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0 for generation 1", "groupId":"KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0","coordinatorId":"0", "type":"END_REBALANCE","group":"GroupMetadata(groupId=KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0, generation=1, protocolType=Some(consumer), currentState=CompletingRebalance, members=Map(consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635 -> MemberMetadata(memberId=consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635, clientId=consumer-1, clientHost=/172.31.2.168, sessionTimeoutMs=10000, rebalanceTimeoutMs=300000, supportedProtocols=List(range), )))"} }
- 结构化字段及字段说明
表2 结构化字段 字段
示例
描述
类型
level
INFO
重平衡日志的等级
string
timestamp
2023-03-23 17:23:22,906
Rebalance时间
string
message.leaderId
consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635
消费者Leader ID
string
message.generationId
1
消费者组Generation ID。Generation等同于消费组执行Rebalance的次数,每次Rebalance完成后,Generation都会增加1。
string
message.reason
Assignment received from leader for group KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0 for generation 1
触发Rebalance的原因
string
message.groupId
KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0
消费组ID
string
message.coordinatorId
0
Coordinator组件所在的Broker
string
message.type
END_REBALANCE
触发Rebalance的操作
string
message.group
GroupMetadata(groupId=KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0, generation=1, protocolType=Some(consumer), currentState=CompletingRebalance, members=Map(consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635 -> MemberMetadata(memberId=consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635, clientId=consumer-1, clientHost=/172.31.2.168, sessionTimeoutMs=10000, rebalanceTimeoutMs=300000, supportedProtocols=List(range), )))
消费组中消费者的信息
string