'Kafka consumer is slow on one of the partitions
I have a topic which has 3 partitions with about 40k records. When I consume from this topic, it works very slow. And I noticed that two partitions quickly send all their ~25k records in less than 1 minute, while the third partition sends only about 300 records and takes another 30 minutes to send the remaining records.
As far as I could tell, the number of records and sizes are evenly distributed between all partitions, I see nothing unusual about the slow partition. Record size is relatively large, about 80kb, if it makes any difference. It is a Kafka cluster with 5 brokers.
Where should I start looking?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|