'How to use Ratelimiter on flink?

I want to throttle the Kafka consumers in my Flink job.

Looking through the source code for Flink 1.12, I find FlinkConnectorRateLimiter and GuavaFlinkConnectorRateLimiter. But I can't find anything connecting this rate limiter to FlinkKafkaConsumer.

How can I implement rate limiting for Kafka in Flink 1.12?

apache-flink


Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source

Related Questions

Kinesis Analytics SQL query to narrow down the sensors that are not sending data

where's socketTextStream in pyflink

What is the Java version that the Flink can support in 2022?

Flink Missing Events With Windowed Processor(Event Time Windows) and Kafka Source

Apache Flink + CEP - Detect same events

Apache Flink: AWS S3 timeout exception when starting a job from a savepoint

Kafka Client Timeout of 60000ms expired before the position for partition could be determined

I'm looking for code to connect PyFlink to Pulsar

FLINK1.8 , ERROR INFO : state is larger than the maximum permitted memory-backed state. use RocksDBStateBackend not useful

Windowing on mapped stream is giving different results

What should I use instead deprecated FlinkKafkaConsumer? Scala Flink

Integration testing flink job

Cannot access Flink dashboard localhost:8081 on windows

Apache Flink - writing stream to S3 error - null uri host

Flink checkpoint not replaying the kafka events which were in process during the savepoint/checkpoint