I try to use Jmeter with plugin "DI-fakfa meter" to load my kafka using SSL. I got the following certificates from VAULT system: -CA -Issuing CA -Private key In
I'm following https://github.com/PacktPublishing/Apache-Kafka-Series---Kafka-Connect-Hands-on-Learning and I've below docker-compose file and using Mac. version
I am using confluent Kafka and schema registry and I cannot figure out a way to have custom schema name in python. From this blog I got how to do it in Java, bu
I am a new beginner in the big data field, I need to make a demo which streams data from Kafka topic using spark stream then make some aggregation and filtering
I'm having Kafka Consumer group of applications (10 instances) written in Java which uses Spring Cloud Stream. Consumer application is deployed in AWS Kubernete
In another similar question, they hint 'install older spark 2.4.5.' EDIT: the solution from above link says 'install spark 2.4.5 and it does have kafkautils. Bu
I'm using Spring Kafka integration and I've my own value generic serializer/deserializer as shown below Serializer: public class KafkaSerializer<T>
I am getting intermittent issues while accessing the kafka service from the Kubernetes pod. org.apache.kafka.common.KafkaException: Failed to construct kafka pr
I need to store to Cassandra and publish to Kafka multiple events, and call some final handler() only after all events are stored and published. I came across U
I have been creating a Kafka Producer example using Java. I have been sending normal data which is just "Test" + Integer as value to Kafka. I have use
I'm getting below error while starting the Kafka-Server on Windows machine. I've downloaded Scala 2.11 - kafka_2.11-2.1.0.tgz from the link: https://kafka.apach
Specs: The serverless Amazon MSK that's in preview. t2.xlarge EC2 instance with Amazon Linux 2 Installed Kafka from https://dlcdn.apache.org/kafka/3.0.0/kafka_2
I'm trying to get Kafka to work on docker-compose for the first time. The application runs fine without docker. But on docker, I get the error as described belo
I'm writing a piece of code that needs to read hundreds of messages from Kafka each few milliseconds. I'm using C++ and librdkafka. When my program stops and th
I have a kafka container started using following docker run --detach --name kafka -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=192.168.1.89 --env ADVERVTIS
My biggest question is that do we have a concept in kafka called as consumer group to be inactive/active. I am not sure how to achieve this in my local kafka
I build a cluster use CDH5.14.2, includes 5 nodes, each node has 130G momery and 40 cpu cores. I builded the spark streamming application to read from multiple
i currently profiled my kafka producer spring boot application and found many "kafka-producer-network-thread"s running (47 in total). Which would never stop run
I have a problem to construct kafka producer with hostname. Here's what I did. 1) I set the host.name, port config to server.properties listeners=PLAINTEXT://
I'm a bit confused on how to configure where the error log files are written for Zookeeper when running ZK and Kafka on the same node. I understand it uses log