Kafka fields
Stack
Kafka module
Broker Consumer Group Information have been read from (Broker handling the consumer group).
kafka.broker.id-
Broker id
type: long
kafka.broker.address-
Broker advertised address
type: keyword
kafka.topic.name-
Topic name
type: keyword
kafka.topic.error.code-
Topic error code.
type: long
kafka.partition.id-
Partition id.
type: long
kafka.partition.topic_id-
Unique id of the partition in the topic.
type: keyword
kafka.partition.topic_broker_id-
Unique id of the partition in the topic and the broker.
type: keyword
Stack
Broker metrics from Kafka Broker JMX
kafka.broker.mbean-
Mbean that this event is related to
type: keyword
kafka.broker.request.channel.queue.size-
The size of the request queue
type: long
kafka.broker.request.produce.failed_per_second-
The rate of failed produce requests per second
type: float
kafka.broker.request.fetch.failed_per_second-
The rate of client fetch request failures per second
type: float
kafka.broker.request.produce.failed-
The number of failed produce requests
type: float
kafka.broker.request.fetch.failed-
The number of client fetch request failures
type: float
kafka.broker.replication.leader_elections-
The leader election rate
type: float
kafka.broker.replication.unclean_leader_elections-
The unclean leader election rate
type: float
kafka.broker.session.zookeeper.disconnect-
The ZooKeeper closed sessions per second
type: float
kafka.broker.session.zookeeper.expire-
The ZooKeeper expired sessions per second
type: float
kafka.broker.session.zookeeper.readonly-
The ZooKeeper readonly sessions per second
type: float
kafka.broker.session.zookeeper.sync-
The ZooKeeper client connections per second
type: float
kafka.broker.log.flush_rate-
The log flush rate
type: float
kafka.broker.topic.net.in.bytes_per_sec-
The incoming byte rate per topic
type: float
kafka.broker.topic.net.out.bytes_per_sec-
The outgoing byte rate per topic
type: float
kafka.broker.topic.net.rejected.bytes_per_sec-
The rejected byte rate per topic
type: float
kafka.broker.topic.messages_in-
The incoming message rate per topic
type: float
kafka.broker.net.in.bytes_per_sec-
The incoming byte rate
type: float
kafka.broker.net.out.bytes_per_sec-
The outgoing byte rate
type: float
kafka.broker.net.rejected.bytes_per_sec-
The rejected byte rate
type: float
kafka.broker.messages_in-
The incoming message rate
type: float
Stack
Consumer metrics from Kafka Consumer JMX
kafka.consumer.mbean-
Mbean that this event is related to
type: keyword
kafka.consumer.fetch_rate-
The minimum rate at which the consumer sends fetch requests to a broker
type: float
kafka.consumer.bytes_consumed-
The average number of bytes consumed for a specific topic per second
type: float
kafka.consumer.records_consumed-
The average number of records consumed per second for a specific topic
type: float
kafka.consumer.in.bytes_per_sec-
The rate of bytes coming in to the consumer
type: float
kafka.consumer.max_lag-
The maximum consumer lag
type: float
kafka.consumer.zookeeper_commits-
The rate of offset commits to ZooKeeper
type: float
kafka.consumer.kafka_commits-
The rate of offset commits to Kafka
type: float
kafka.consumer.messages_in-
The rate of consumer message consumption
type: float
consumergroup
kafka.consumergroup.id-
Consumer Group ID
type: keyword
kafka.consumergroup.offset-
consumer offset into partition being read
type: long
kafka.consumergroup.meta-
custom consumer meta data string
type: keyword
kafka.consumergroup.consumer_lag-
consumer lag for partition/topic calculated as the difference between the partition offset and consumer offset
type: long
kafka.consumergroup.error.code-
kafka consumer/partition error code.
type: long
Assigned client reading events from partition
kafka.consumergroup.client.id-
Client ID (kafka setting client.id)
type: keyword
kafka.consumergroup.client.host-
Client host
type: keyword
kafka.consumergroup.client.member_id-
internal consumer group member ID
type: keyword
partition
Available offsets of the given partition.
kafka.partition.offset.newest-
Newest offset of the partition.
type: long
kafka.partition.offset.oldest-
Oldest offset of the partition.
type: long
Partition data.
kafka.partition.partition.leader-
Leader id (broker).
type: long
kafka.partition.partition.replica-
Replica id (broker).
type: long
kafka.partition.partition.insync_replica-
Indicates if replica is included in the in-sync replicate set (ISR).
type: boolean
kafka.partition.partition.is_leader-
Indicates if replica is the leader
type: boolean
kafka.partition.partition.error.code-
Error code from fetching partition.
type: long
Stack
Producer metrics from Kafka Producer JMX
kafka.producer.mbean-
Mbean that this event is related to
type: keyword
kafka.producer.available_buffer_bytes-
The total amount of buffer memory
type: float
kafka.producer.batch_size_avg-
The average number of bytes sent
type: float
kafka.producer.batch_size_max-
The maximum number of bytes sent
type: long
kafka.producer.record_send_rate-
The average number of records sent per second
type: float
kafka.producer.record_retry_rate-
The average number of retried record sends per second
type: float
kafka.producer.record_error_rate-
The average number of retried record sends per second
type: float
kafka.producer.records_per_request-
The average number of records sent per second
type: float
kafka.producer.record_size_avg-
The average record size
type: float
kafka.producer.record_size_max-
The maximum record size
type: long
kafka.producer.request_rate-
The number of producer requests per second
type: float
kafka.producer.response_rate-
The number of producer responses per second
type: float
kafka.producer.io_wait-
The producer I/O wait time
type: float
kafka.producer.out.bytes_per_sec-
The rate of bytes going out for the producer
type: float
kafka.producer.message_rate-
The producer message rate
type: float