'NiFi Cluster Docker Load Balancing configuration

I would like to configure Load Balancing in docker-compose.yml file for NiFi cluster deployed via Docker containers. Current docker-compose parameters for LB are as follows (for each of three NiFi nodes):

      # load balancing
      - NIFI_CLUSTER_LOAD_BALANCE_PORT=6342
      - NIFI_CLUSTER_LOAD_BALANCE_HOST=node.name
      - NIFI_CLUSTER_LOAD_BALANCE_CONNECTIONS_PER_NODE=4
      - NIFI_CLUSTER_LOAD_BALANCE_MAX_THREADS=8

But, when I try to use load balancing in queues, I can choose all the parameters there, and do not have any error, but LB is not working, everything is done on the primary node (because I used GetSFTP on the primary node only, but want to then process data on all 3 nodes). Also, NiFi cluster is configured to work with SSL.

Thanks in advance!



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source