'Send Fluentd logs to another Fluentd installed in another machine : failed to flush the buffer error="no nodes are available"

I'm trying to send the logs from fluentd to another fluentd, both are installed in two different machines (ubuntu) that I get access to through PuTTy.

The match clause of Fluentd.conf of log forwarder is the following :

<source>
 @type tail
 path /opt/bitnami/apache2/logs/*.gz
 pos_file /var/log/td-agent/httpd-access.log.pos
 tag apache.access
 format apache2
</source>

<match **>
 @type copy
 <store>
  @type forward
  @id forward_output
  heartbeat_type tcp
  <server>
   host private_ip_addr
   port 24224
  </server>
  flush_interval 1s
 </store>
 <store>
  @type stdout
 </store>
</match>

To test if the logs are pulled properly I tried sending them to a local directory, and I did find them so source section works well. I can ping the machines. the fluentd.conf of log aggregator is the following :

<source>
 @type forward
 @id forward_input
 port 24224
</source>
<match **>
 @type stdout
</match>

I get ping the machines using the private IP adresse. I've been trying for a while, some help would be very much appreciated!

fluentd


Solution 1:[1]

Just tested the same scenario on the same machine and it's working fine.

fluentd 1.14.6

fluent1.conf

<source>
  @type sample
  tag test
</source>

<match test>
  @type copy
  <store>
    @type forward
    <server>
      host localhost
    </server>
    flush_interval 1s
  </store>
  <store>
    @type stdout
  </store>
</match>

Run:

fluentd -c fluent1.conf

fluent2.conf

<source>
  @type forward
  tag test
</source>

<match test>
  @type stdout
</match>

Run:

fluentd -c fluent2.conf

Demo

demo

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 Azeem

Related Questions