Packt+ | Advance your knowledge in tech

You're reading from Apache Kafka 1.0 Cookbook Over 100 practical recipes on using distributed enterprise messaging to handle real-time data

Product type Paperback

Published in Dec 2017

Publisher Packt

ISBN-13 9781787286849

Length 250 pages

Edition 1st Edition

Languages

Java

Tools

Kafka

Concepts

Data Analysis

Authors (2):

Estrada

Zinoviev

Preface

1. Configuring Kafka

2. Kafka Clusters FREE CHAPTER

3. Message Validation

4. Message Enrichment

5. The Confluent Platform

6. Kafka Streams

7. Managing Kafka

8. Operating Kafka

9. Monitoring and Security

10. Third-Party Tool Integration

As well as producer metrics, there are also consumer metrics.

For this recipe, we just need a Kafka broker up and running and JConsole installed.

$ JMX_PORT=10103 bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --from-beginning --topic test_topic

$ jconsole 127.0.0.1:10103

In the following screenshot, see the MBeans tab with the Kafka consumer metrics:

Figure 9.4: MBeans tab showing the Kafka consumer metrics

Switch to the MBeans tab in JConsole; there are several consumer metrics. They are as follows:

kafka.consumer:type=ConsumerFetcherManager,name=MaxLag,clientId=test-consumer-group: This tells us by how many messages the consumer is lagging behind the producer.
kafka.consumer:type=ConsumerFetcherManager,name=MinFetchRate,clientId=test-consumer-group: This gives the minimum rate at which the consumer...