Category "spring-kafka"

@RetryableTopic showing weird behaviour when using with topicPartitions to reset offset - spring kafka

I am trying to use @RetryableTopic for unblocking retries and topicPartitions in order to read messages from beginning. Below is my listener (I have only one pa

Connect to confluent schema registry SSL configuration - unable to find valid certification path to requested target

How should it be configured the spring-cloud-schema-registry-client to communicate with Confluent Schema Registry on a secured manner using SSL truststore? My c

Embedded Kafka contract tests randomly failing

I am using the spring cloud contrat to test a kafkaListsener of my service. I use EmbeddedKafka together with the spring cloud contract. The listener in my serv

Kafka org.apache.kafka.common.errors.TimeoutException for some of the records

Getting below error message when producing record to Azure event hub(kafka enabled) Expiring 14 record(s) for eventhubname: 30125 ms has passed since batch cre

Intercept Kafka rollback in a Spring Batch

In a Spring Batch I developed an ItemWriter that use a StreamBridge to write to Kafka with a transactional producer. With a CompositeItemWriter, the step use al

Spring Apache Kafka onFailure Callback of KafkaTemplate not fired on connection error

I'm experimenting a lot with Apache Kafka in a Spring Boot App at the moment. My current goal is to write a REST endpoint that takes in some message payload, wh

The listener info header is not added when using a batch listener

The issue 2134 introduced a way to set arbitrary information using the info property of the KafkaListener annotation. This info is then added as a header on the

Kafka Consumer - Point to specific offset in Spring boot Kafka

I'm trying to seek the offset to some specific offset. It seems I need to use seekToTimestamp and there is no seekToOffset or something. I've research a lot but

JSON array serialization issue after spring-cloud-stream update

I use spring-cloud-stream-binder-kafka to connect to the kafka broker I updated spring-cloud-dependencies version to 2021.0.1 I went from this [INFO] +- org.spr

Is it possible to check Kafka broker and the topic which Im sending message is healthy before sending message

I have a batch application which needs to send message to two different Kafka topic on two different clusters. I want to make sure my kafka broker in which my p

how to send a byte array in kafka with Avro Schema registry

I'm trying to send bytes with a JSON object using a Java POJO and an Avro schema, with schema registry. So my question is, how should my code send "bytes" type

Kafka EOS retry flag

I have a Kafka cluster and a spring boot application that is configured for EOS. The application consumes from topic A performs some business logic then produce

Spring Cloud Stream - Is there a way to customize the StreamThread thread name?

I'm using Spring Cloud Stream (Kafka as the binder) in my current project and the default thread name for StreamThread keeps me bothered as it is very long. Her

Spring cloud streams kafka streams state store

I want to get state store with custom key and value. I have a kafka topic example-kafka-topic-event. This is how I get ktable at the code level: @Component("exa

Profiles property is deprecated is properties.yml for Spring-Kafka

I'm configuring the application.yml file in my Spring Kafka MS and I'm getting a notification that the profiles property is deprecated. This 'profiles' property

Spring Kafka Batch listener not receiving more than 1 or 2 messages

Spring Kafka Batch consumer receives only one or two messages we have increased fetch.min.bytes to 9000 and fetch.max.wait.ms 5000 [Based on this answ

StreamsException: Unable to initialize state, this can happen if multiple instances of Kafka Streams are running in the same state directory

This is regarding upgrading existing code base in production which uses windowing from kafka-clients,kafka-streams,spring-kafka 2.4.0 to 2.6.x and also upgradi

DefaultErrorHandler doesn't log not retryable exceptions

Not retryable exceptions are not logged in DefaultErrorHandler when used with DeadLetterPublishingRecoverer. @Bean public CommonErrorHandler consumerErrorHandle

Can one Kafka Producer Class have multiple @EventListener methods?

Im using Spring Kafka and wrote Producer Class @Component @RequiredArgsConstructor class Producer { private static final String TOPIC = "channels"; pri

Can one Kafka Producer Class have multiple @EventListener methods?

Im using Spring Kafka and wrote Producer Class @Component @RequiredArgsConstructor class Producer { private static final String TOPIC = "channels"; pri