Help Center> Log Tank Service> User Guide> Log Ingestion> Collecting Logs from Cloud Services> Collecting Logs from DMS for Kafka
Updated on 2024-01-25 GMT+08:00
View PDF

Collecting Logs from DMS for Kafka

LTS can collect logs from Distributed Message Service (DMS) for Kafka. For details, see Viewing Rebalancing Logs.

Structuring Template Details

  • DMS rebalancing log example
    Table 1 Structuring template example

    Template Name

    Example Log

    DMS rebalancing logs

    		 
    { "level":"INFO", "timestamp":"2023-03-23 17:23:22,906", "message":{ "leaderId":"consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635", "generationId":"1","reason":"Assignment received from leader for group KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0 for generation 1", "groupId":"KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0","coordinatorId":"0", "type":"END_REBALANCE","group":"GroupMetadata(groupId=KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0, generation=1, protocolType=Some(consumer), currentState=CompletingRebalance, members=Map(consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635 -> MemberMetadata(memberId=consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635, clientId=consumer-1, clientHost=/172.31.2.168, sessionTimeoutMs=10000, rebalanceTimeoutMs=300000, supportedProtocols=List(range), )))"} }
  • Structuring fields and description
    Table 2 Structuring fields

    Field

    Example

    Description

    Type

    level

    INFO

    Level of the rebalancing log.

    string

    timestamp

    2023-03-23 17:23:22,906

    Time of rebalancing.

    string

    message.leaderId

    consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635

    Leader consumer ID.

    string

    message.generationId

    1

    Generation ID of the consumer group. Generation is the number of times that a consumer group performs rebalancing. It is incremented by 1 each time a rebalancing is complete.

    string

    message.reason

    Assignment received from leader for group KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0 for generation 1

    Reason for triggering rebalancing.

    string

    message.groupId

    KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0

    Consumer group ID.

    string

    message.coordinatorId

    0

    Broker where the Coordinator component is located.

    string

    message.type

    END_REBALANCE

    Operation that triggered rebalancing.

    string

    message.group

    GroupMetadata(groupId=KMOffsetCache-dms-vm-fa3cf9d6-manager-shared-server-0, generation=1, protocolType=Some(consumer), currentState=CompletingRebalance, members=Map(consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635 -> MemberMetadata(memberId=consumer-1-177817b6-1f29-4717-8a83-dda8eaab1635, clientId=consumer-1, clientHost=/172.31.2.168, sessionTimeoutMs=10000, rebalanceTimeoutMs=300000, supportedProtocols=List(range), )))

    Information about consumers in the consumer group.

    string