'Kafka Quota for broker hosting multiple leader replicas
Bandwidth-throttling
Based on the Kafka Quotas (https://cwiki.apache.org/confluence/display/KAFKA/KIP-13+-+Quotas), client-id is assigned with quota for particular broker. This is assuming all the leader replicas for partitions are hosted on different brokers. But what If one broker hosting multiple leader replicas for partitions?
For example: I have 1 client-id sending the produce/consume requests to 1 topic. And the topic has 10 partitions and leader replicas for these 10 partitions are hosted on different brokers. Let's say I have quota of 20000 bytes/sec per broker for a client-id, then quota for each broker is 20000 bytes. Here, leader replicas for all 10 partitions are hosted on different brokers.
What If I have 5 brokers hosting 2 leader replicas each for total 10 partitions. And the quota is set for 20000 bytes/sec. Then what would be the quota for each broker before it throttles the client? 20000 bytes or 20000 * 2 bytes (because of 2 leader replicas on one broker)?
Does anyone have idea around this scenario? I did not get enough idea from Kafka documentation.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
