| 10 Jan 2024 |
|  remi_84057 joined the room. | 11:08:50 |
|  rverchere joined the room. | 11:11:25 |
|  magical_kitten_02917 joined the room. | 14:11:37 |
| magical_kitten_02917 | Download flow-prometheus-input.yaml | 15:16:32 |
| magical_kitten_02917 | Hey, I am new to fluentd and try to setup a pipeline to forward application logs to be consumed by prometheus, following is the config. I used custom fluentbit config and I think it works, but I don't see any logs on fluentd and can't verify if it's working as expected. Can you help me out? I don't see anything in pod logs. I tried almost everything which I could find.
Attached is the configuration.
I would really appreciate the help. Thanks | 15:16:33 |
| 11 Jan 2024 |
 WrenIX | You do not has set any labels to the serviceMonitor ...
thats the way i set it up with the helm-chart:
https://codeberg.org/wrenix/flux-charts/src/commit/4e456bfb5ba537400a174dfc463ba7d82f8de3fe/infra-logging/templates/logging-operator/release.yaml#L69-L71 | 12:36:34 |
| WrenIX | If your prometheus(-operator) find your serviceMonitor you could check here: http://prometheus:8080/service-discovery?search=fluentd-metrics | 12:38:51 |
| WrenIX | or check the genreated config: http://prometheus:8080/config | 12:39:42 |
| WrenIX | If that works - the next check is your Flow - prometheus-filter:
the loggingoperator does not init the metrics (with zero) -> but the help text is generated - take a look on the metric-endpoint (maybe per port-forward on one of the fluentd metric endpoint - default on port 24231) | 12:43:27 |
| WrenIX | maybe with:
curl -s localhost:24231/metrics | grep -nr gateway_topic_request_count
| 12:45:04 |
| WrenIX | * maybe with:
curl -s localhost:24231/metrics | grep gateway_topic_request_count
| 12:45:22 |
| WrenIX | Here my global Filter on Logging to get the an counter for all collected (before parsing or so):
https://codeberg.org/wrenix/flux-charts/src/commit/4e456bfb5ba537400a174dfc463ba7d82f8de3fe/infra-logging/templates/logging-operator/release.yaml#L119-L132 | 12:48:17 |
| magical_kitten_02917 | Hi, Actually I can see the metric in fluentd /metrics endpoint but the count is always 0, but the main issue I am facing right now is that I don't see any incoming data from fluentbit, the pod logs are blank and the fluentd/log/out also doesn't show any entries of incoming traffic. I just want to confirm if the pipeline is working file. I even tried the stdout file stuff and that too isn't working. So just want to confirm if there is something wrong with the fluentd deployment or Am I missing something! | 14:34:31 |
 pepov | Hey all, I am new to fluentd and try to | 15:07:48 |
| WrenIX | * maybe with:
curl -s localhost:24231/metrics | grep gateway_topic_request_count
or
| 17:46:31 |
| WrenIX | * maybe with:
curl -s localhost:24231/metrics | grep gateway_topic_request_count
or
curl -s localhost:24231/metrics | grep HELP
| 17:46:47 |
| WrenIX | * maybe with:
curl -s localhost:24231/metrics | grep gateway_topic_request_count
or (grep after HELP Text, where you also get the fluentd metrics)
curl -s localhost:24231/metrics | grep HELP
| 17:47:29 |
| 12 Jan 2024 |
|  .fsh joined the room. | 11:34:26 |
| pepov | fyi the latest image breaks on arm64: https://stackoverflow.com/questions/77725755/segmentation-fault-during-rails-assetsprecompile-on-apple-silicon-m3-with-rub | 14:38:19 |
| pepov | if you have the same issue, you can switch back to v1.16-ruby3.2-full | 14:38:39 |
| 31 Jan 2024 |
|  Martin Müller (Phoenix 🐦) changed their display name from 🐦Martin 🔥Müller (Phoenix AMO) to Martin Müller (Phoenix 🦆 - way till 2024-02-19). | 20:09:39 |
| Martin Müller (Phoenix 🐦) changed their display name from Martin Müller (Phoenix 🦆 - way till 2024-02-19) to Martin Müller (Phoenix 🦆 - away till 2024-02-19). | 20:41:26 |
| 9 Feb 2024 |
| Room Avatar Renderer. | 11:30:28 |
| 14 Feb 2024 |
|  genofire left the room. | 00:36:44 |
|  genofire joined the room. | 01:24:57 |
| WrenIX left the room. | 22:15:32 |
| 15 Feb 2024 |
| Martin Müller (Phoenix 🐦) changed their display name from Martin Müller (Phoenix 🦆 - away till 2024-02-19) to Martin Müller (Phoenix 🦆). | 10:58:43 |
| 23 Apr 2024 |
| Martin Müller (Phoenix 🐦) changed their display name from Martin Müller (Phoenix 🦆) to Martin Müller (Phoenix 🦆 away till 16.5). | 14:30:13 |
| 24 May 2024 |
| Martin Müller (Phoenix 🐦) changed their display name from Martin Müller (Phoenix 🦆 away till 16.5) to Martin Müller (Phoenix 🦆). | 08:22:36 |
| Martin Müller (Phoenix 🐦) changed their display name from Martin Müller (Phoenix 🦆) to Martin Müller (Phoenix 🐦). | 08:23:12 |
