Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Connect to kafka but error "brokers are down" #9395

Open
tnubeo1111 opened this issue Sep 17, 2024 · 1 comment
Open

Connect to kafka but error "brokers are down" #9395

tnubeo1111 opened this issue Sep 17, 2024 · 1 comment
Labels
status: waiting-for-triage waiting-for-user Waiting for more information, tests or requested changes

Comments

@tnubeo1111
Copy link

Bug Report

Describe the bug
Hello team, I am trying to push logs from fluent bit to kafka along with some kafka authentication information but I get error "fluent-bit#producer-1: [thrd:sasl_plaintext://172.26.24.84:31504 /bootstrap]: 3/3 brokers are down"

To Reproduce
[2024/09/17 12:25:38] [ info] [fluent bit] version=3.1.8, commit=315fc06e5e, pid=1
[2024/09/17 12:25:38] [debug] [engine] coroutine stack size: 24576 bytes (24.0K)
[2024/09/17 12:25:38] [ info] [storage] ver=1.5.2, type=memory, sync=normal, checksum=off, max_chunks_up=128
[2024/09/17 12:25:38] [ info] [cmetrics] version=0.9.6
[2024/09/17 12:25:38] [ info] [ctraces ] version=0.5.5
[2024/09/17 12:25:38] [ info] [input:syslog:syslog.0] initializing
[2024/09/17 12:25:38] [ info] [input:syslog:syslog.0] storage_strategy='memory' (memory only)
[2024/09/17 12:25:38] [debug] [syslog:syslog.0] created event channels: read=21 write=22
[2024/09/17 12:25:38] [debug] [downstream] listening on 0.0.0.0:5140
[2024/09/17 12:25:38] [ info] [in_syslog] TCP server binding 0.0.0.0:5140
[2024/09/17 12:25:38] [debug] [kafka:kafka.0] created event channels: read=24 write=25
[2024/09/17 12:25:38] [ info] [output:kafka:kafka.0] brokers='172.26.24.84:31504, 172.26.24.84:30969, 172.26.24.84:31924' topics='maas-vcr-log'
[2024/09/17 12:25:38] [ info] [sp] stream processor started
[2024/09/17 12:25:39] [error] [output:kafka:kafka.0] fluent-bit#producer-1: [thrd:sasl_plaintext://172.26.24.84:31504/bootstrap]: 3/3 brokers are down

Screenshots

  • Config Out put Fluent-bit
    image

Your Environment

  • Version used: fluent/fluent-bit:latest
  • Environment name and version (e.g. Kubernetes? What version?):
    • Kubernet: v1.25.0
@patrick-stephens
Copy link
Contributor

Are they down?
Is that the right config for them?
Are those IPs and ports routable from wherever you are running FB? Debug images can be used to test this easily.
Is it in cluster, external?
Clarify the version - latest might not be pulled often so is it 3.1.8?
Can you fill out the rest of the environment information?

@patrick-stephens patrick-stephens added the waiting-for-user Waiting for more information, tests or requested changes label Sep 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status: waiting-for-triage waiting-for-user Waiting for more information, tests or requested changes
Projects
None yet
Development

No branches or pull requests

2 participants