Kafka org.apache.kafka.common.errors.TimeoutException for some of the records

Question

Getting below error message when producing record to Azure event hub(kafka enabled)

Expiring 14 record(s) for eventhubname: 30125  ms has passed since batch creation plus linger time

Stack used azure eventhub , Spring kafka

below config present in Kafka producer config

props.put(ProducerConfig.RETRIES_CONFIG, "3");

Would like to know if kafka producer will be retried 3 times incase of above error message

Answer 1

ProducerConfig.RETRIES_CONFIG -> This configuration has no use. Default retry is set as Integer.MAX_VALUE = 2147483647.

Producer automatically retry in case of failure.

Kindly check following configuration and tune accordingly.

• linger.ms=0 ( try with zero, this will send batch request as soon as possible, Non zero value require more tuning along with other parameters)
• buffer.memory -> Max memory used by Producer in buffer, try increasing this.
• max.block.ms -> check this value, This is probable cause of timeoutException. Increase this as per scenario.