Bug 254628

Summary: sysutils/fluent-bit: tail plugin not supported
Product: Ports & Packages Reporter: pete
Component: Individual Port(s)Assignee: Palle Girgensohn <girgen>
Status: New ---    
Severity: Affects Only Me CC: freebsd.org, freebsd
Priority: --- Flags: bugzilla: maintainer-feedback? (girgen)
Version: Latest   
Hardware: Any   
OS: Any   

Description pete 2021-03-28 16:09:38 UTC
I am working on rolling out fluent-bit and currently make use of the tail plugin for my ruby based fluentd systems.  When trying to run this on FreeBSD it get an error:

$ fluent-bit -s 6000 -i tail  -p path=/var/log/messages -o stdout
Fluent Bit v1.7.2
* Copyright (C) 2019-2021 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2021/03/28 09:00:34] [ info] [engine] started (pid=50457)
[2021/03/28 09:00:34] [ info] [storage] version=1.1.1, initializing...
[2021/03/28 09:00:34] [ info] [storage] in-memory
[2021/03/28 09:00:34] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
[2021/03/28 09:00:34] [ info] [sp] stream processor started
[2021/03/28 09:00:34] [error] [plugins/in_tail/tail_file.c:1088 errno=63] File name too long


After some digging it looks like their tail implementation is only supported on Linux/OSX and Windows:
https://github.com/fluent/fluent-bit/issues/208
https://github.com/fluent/fluent-bit/issues/2897

Filing this ticket to see if it would be possible to get a patch together to add support for the tail plugin.
Comment 1 Christopher Beppler 2021-05-03 13:22:14 UTC
Maybe it would be worthwile to set the CMake option FLB_IN_TAIL the this port to to False until this has been implemented upstream?
Comment 2 bgdnlp 2021-07-15 11:17:16 UTC
Any idea of the status of tail plugin in FreeBSD please?

Installed fluent-bit 1.7.9 from packages, enabled tail plugin, we get this in logs every couple of seconds or so:

[error] [/wrkdirs/usr/ports/sysutils/fluent-bit/work/.build/plugins/in_tail/CMakeFiles/flb-plugin-in_tail.dir/compiler_depend.ts:1104 errno=2] No such file or directory

The plugin seems to work though, it reads files and sends the data, but I'm not sure what the error means or if it will still work later, on file rotation for example.

(there's also the issue that fluent-bit dies if the `-d` flag is passed to it (daemon on), but I can report that separately)
Comment 3 Christopher Beppler 2021-07-15 14:46:01 UTC
Hi, the second issue with -d is possibly related to #255593.
Comment 4 bgdnlp 2021-07-16 06:31:26 UTC
(In reply to Christopher Beppler from comment #3)

I've seen that ticket, but I wasn't sure what to make of it. It starts, but not as daemon. I'll add my comments there.