'AWS MSK - Too many open files
Have a kafka-connect cluster ingesting data (through debezium connectors) into a 4 node MSK cluster
Getting a java.net.SocketException: Too many open files file descriptor error,which points to exceeding the default set limit
2022-03-22 14:36:01,424 WARN || [Producer clientId=connector-dlq-producer-xxxx_sink_connector-6] Error connecting to node b-2.broker-x.xxxxx.c1.kafka.eu-central-1.amazonaws.com:9092 (id: 2 rack: euc1-az3) [org.apache.kafka.clients.NetworkClient]
Not sure how to change the Ulimit setting on AWS MSK, any pointers?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|