fluentbit не может связаться с fluentd

Я пробую простой тест fluentbit / fluentd с ipv6, но он не работает.

Конфигурация со стороны fluentbit:

[SERVICE]
    Flush         5
    Daemon        off
[INPUT]
    Name              cpu
    Tag               fluent_bit
[OUTPUT]
    Name   forward
    Match  *
    Host   fd00:7fff:0:2:9c43:9bff:fe00:bb
    Port   24000

Конфигурация со стороны fluentd:

<source>
  type forward
  bind ::
  port 24000
</source>
~
<match fluent_bit>
  type stdout
</match>

Я запускаю fluentd командой: /usr/sbin/td-agent -c test.conf

Затем я запускаю fluentbit командой: /opt/td-agent-bit/bin/td-agent-bit -c test.conf

Вывод показывает, что существует проблема со связью:

Fluent Bit v1.6.6
* Copyright (C) 2019-2020 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2020/11/29 01:53:49] [ info] [engine] started (pid=142)
[2020/11/29 01:53:49] [ info] [storage] version=1.0.6, initializing...
[2020/11/29 01:53:49] [ info] [storage] in-memory
[2020/11/29 01:53:49] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
[2020/11/29 01:53:49] [ info] [sp] stream processor started
[2020/11/29 01:53:53] [error] [io] connection #27 failed to: fd00:7fff:0:2:9c43:9bff:fe00:bb:24000
[2020/11/29 01:53:53] [error] [output:forward:forward.0] no upstream connections available
[2020/11/29 01:53:53] [ warn] [engine] failed to flush chunk '142-1606614829.871139401.flb', retry in 8 seconds: task_id=0, input=cpu.0 > output=forward.0
[2020/11/29 01:53:58] [error] [io] connection #28 failed to: fd00:7fff:0:2:9c43:9bff:fe00:bb:24000
[2020/11/29 01:53:58] [error] [output:forward:forward.0] no upstream connections available
[2020/11/29 01:53:58] [ warn] [engine] failed to flush chunk '142-1606614833.871418916.flb', retry in 6 seconds: task_id=1, input=cpu.0 > output=forward.0
[2020/11/29 01:54:01] [error] [io] connection #29 failed to: fd00:7fff:0:2:9c43:9bff:fe00:bb:24000
[2020/11/29 01:54:01] [error] [output:forward:forward.0] no upstream connections available
[2020/11/29 01:54:01] [ warn] [engine] chunk '142-1606614829.871139401.flb' cannot be retried: task_id=0, input=cpu.0 > output=forward.0

Однако, когда я запускаю команду без использования файла конфигурации, но с передачей параметров, она работает:

# /opt/td-agent-bit/bin/td-agent-bit -i cpu -t fluent_bit -o forward://[fd00:7fff:0:2:9c43:9bff:fe00:bb]:24000 -v
Fluent Bit v1.6.6
* Copyright (C) 2019-2020 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2020/11/29 01:56:53] [ info] Configuration:
[2020/11/29 01:56:53] [ info]  flush time     | 5.000000 seconds
[2020/11/29 01:56:53] [ info]  grace          | 5 seconds
[2020/11/29 01:56:53] [ info]  daemon         | 0
[2020/11/29 01:56:53] [ info] ___________
[2020/11/29 01:56:53] [ info]  inputs:
[2020/11/29 01:56:53] [ info]      cpu
[2020/11/29 01:56:53] [ info] ___________
[2020/11/29 01:56:53] [ info]  filters:
[2020/11/29 01:56:53] [ info] ___________
[2020/11/29 01:56:53] [ info]  outputs:
[2020/11/29 01:56:53] [ info]      forward.0
[2020/11/29 01:56:53] [ info] ___________
[2020/11/29 01:56:53] [ info]  collectors:
[2020/11/29 01:56:53] [ info] [engine] started (pid=151)
[2020/11/29 01:56:53] [debug] [engine] coroutine stack size: 24576 bytes (24.0K)
[2020/11/29 01:56:53] [debug] [storage] [cio stream] new stream registered: cpu.0
[2020/11/29 01:56:53] [ info] [storage] version=1.0.6, initializing...
[2020/11/29 01:56:53] [ info] [storage] in-memory
[2020/11/29 01:56:53] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
[2020/11/29 01:56:53] [debug] [forward:forward.0] created event channels: read=20 write=21
[2020/11/29 01:56:53] [debug] [router] default match rule cpu.0:forward.0
[2020/11/29 01:56:53] [ info] [sp] stream processor started
[2020/11/29 01:56:57] [debug] [task] created task=0x7f9b4e8580a0 id=0 OK
[2020/11/29 01:56:57] [debug] [output:forward:forward.0] request 5525 bytes to flush
[2020/11/29 01:56:57] [debug] [upstream] KA connection #27 to fd00:7fff:0:2:9c43:9bff:fe00:bb:24000 is now available
[2020/11/29 01:56:57] [debug] [task] destroy task=0x7f9b4e8580a0 (task_id=0)
[2020/11/29 01:57:02] [debug] [task] created task=0x7f9b4e8580a0 id=0 OK
[2020/11/29 01:57:02] [debug] [output:forward:forward.0] request 4420 bytes to flush

Кто-нибудь понимает, в чем разница и как я могу исправить эту проблему?


person kiwo    schedule 29.11.2020    source источник
comment
Похоже, что два процесса пытаются использовать один и тот же порт, но это не работает. При запуске без файла конфигурации будет выбран временный порт. Только серверная сторона должна быть настроена с номером порта, клиентская сторона должна выбрать свой собственный.   -  person Ron Maupin    schedule 29.11.2020
comment
Привет, Рон. Извините, я не упомянул, что мой сервер и клиенты находятся в разных контейнерах.   -  person kiwo    schedule 30.11.2020


Ответы (1)


Я решил эту проблему, взяв исходный код из последнего проекта fluent-bit и скомпилировав его. Затем я заменил / usr / sbin / td-agent-bit недавно созданным fluent-bit (как td-agent).

person kiwo    schedule 01.12.2020