!QMMeAXdkLarsXxuGRg:matrix.org

Logging Operator

184 Members
6 Servers

Load older messages


SenderMessageTime
9 Jan 2024
@_discord_1194339285592191068:t2bot.iovignan_21028 did complete the setup but when i annotate my pod do not see side container being started up 20:12:37
10 Jan 2024
@_discord_306521119928877056:t2bot.iooverorion File tailer webhook 07:24:34
@_discord_690176260885970978:t2bot.iooshri7737 joined the room.09:47:47
@_discord_1146726892695728179:t2bot.ioremi_84057 joined the room.11:08:50
@_discord_886955381715267604:t2bot.iorverchere joined the room.11:11:25
@_discord_1194644378464038922:t2bot.iomagical_kitten_02917 joined the room.14:11:37
@_discord_1194644378464038922:t2bot.iomagical_kitten_02917Download flow-prometheus-input.yaml15:16:32
@_discord_1194644378464038922:t2bot.iomagical_kitten_02917 Hey, I am new to fluentd and try to setup a pipeline to forward application logs to be consumed by prometheus, following is the config. I used custom fluentbit config and I think it works, but I don't see any logs on fluentd and can't verify if it's working as expected. Can you help me out? I don't see anything in pod logs. I tried almost everything which I could find.
Attached is the configuration.
I would really appreciate the help. Thanks
15:16:33
11 Jan 2024
@wrenix:chaos.fyiWrenIXYou do not has set any labels to the serviceMonitor ... thats the way i set it up with the helm-chart: https://codeberg.org/wrenix/flux-charts/src/commit/4e456bfb5ba537400a174dfc463ba7d82f8de3fe/infra-logging/templates/logging-operator/release.yaml#L69-L7112:36:34
@wrenix:chaos.fyiWrenIXIf your prometheus(-operator) find your serviceMonitor you could check here: http://prometheus:8080/service-discovery?search=fluentd-metrics12:38:51
@wrenix:chaos.fyiWrenIXor check the genreated config: http://prometheus:8080/config12:39:42
@wrenix:chaos.fyiWrenIXIf that works - the next check is your Flow - prometheus-filter: the loggingoperator does not init the metrics (with zero) -> but the help text is generated - take a look on the metric-endpoint (maybe per port-forward on one of the fluentd metric endpoint - default on port 24231)12:43:27
@wrenix:chaos.fyiWrenIX

maybe with:

curl -s localhost:24231/metrics | grep -nr gateway_topic_request_count
12:45:04
@wrenix:chaos.fyiWrenIX *

maybe with:

curl -s localhost:24231/metrics | grep gateway_topic_request_count
12:45:22
@wrenix:chaos.fyiWrenIX Here my global Filter on Logging to get the an counter for all collected (before parsing or so):
https://codeberg.org/wrenix/flux-charts/src/commit/4e456bfb5ba537400a174dfc463ba7d82f8de3fe/infra-logging/templates/logging-operator/release.yaml#L119-L132
12:48:17
@_discord_1194644378464038922:t2bot.iomagical_kitten_02917 Hi, Actually I can see the metric in fluentd /metrics endpoint but the count is always 0, but the main issue I am facing right now is that I don't see any incoming data from fluentbit, the pod logs are blank and the fluentd/log/out also doesn't show any entries of incoming traffic. I just want to confirm if the pipeline is working file. I even tried the stdout file stuff and that too isn't working. So just want to confirm if there is something wrong with the fluentd deployment or Am I missing something! 14:34:31
@_discord_484298787846881280:t2bot.iopepov Hey all, I am new to fluentd and try to 15:07:48
@wrenix:chaos.fyiWrenIX *

maybe with:

curl -s localhost:24231/metrics | grep gateway_topic_request_count

or

17:46:31
@wrenix:chaos.fyiWrenIX *

maybe with:

curl -s localhost:24231/metrics | grep gateway_topic_request_count

or

curl -s localhost:24231/metrics | grep HELP
17:46:47
@wrenix:chaos.fyiWrenIX *

maybe with:

curl -s localhost:24231/metrics | grep gateway_topic_request_count

or (grep after HELP Text, where you also get the fluentd metrics)

curl -s localhost:24231/metrics | grep HELP
17:47:29
12 Jan 2024
@_discord_252833123220324352:t2bot.io.fsh joined the room.11:34:26
@_discord_484298787846881280:t2bot.iopepov fyi the latest image breaks on arm64: https://stackoverflow.com/questions/77725755/segmentation-fault-during-rails-assetsprecompile-on-apple-silicon-m3-with-rub 14:38:19
@_discord_484298787846881280:t2bot.iopepov if you have the same issue, you can switch back to v1.16-ruby3.2-full 14:38:39
31 Jan 2024
@martin.mueller:dataport.modular.imMartin Müller (Phoenix 🦆) changed their display name from 🐦‍Martin 🔥Müller (Phoenix AMO) to Martin Müller (Phoenix 🦆 - way till 2024-02-19).20:09:39
@martin.mueller:dataport.modular.imMartin Müller (Phoenix 🦆) changed their display name from Martin Müller (Phoenix 🦆 - way till 2024-02-19) to Martin Müller (Phoenix 🦆 - away till 2024-02-19).20:41:26
9 Feb 2024
Room Avatar Renderer.11:30:28
14 Feb 2024
@genofire:chaos.fyigenofire left the room.00:36:44
@genofire:bremen.socialgenofire joined the room.01:24:57
@wrenix:chaos.fyiWrenIX left the room.22:15:32
15 Feb 2024
@martin.mueller:dataport.modular.imMartin Müller (Phoenix 🦆) changed their display name from Martin Müller (Phoenix 🦆 - away till 2024-02-19) to Martin Müller (Phoenix 🦆).10:58:43

There are no newer messages yet.


Back to Room ListRoom Version: 10