Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broken "Ignore Older" setting in in_tail plugin #9021

Open
Lumiond opened this issue Jun 28, 2024 · 0 comments
Open

Broken "Ignore Older" setting in in_tail plugin #9021

Lumiond opened this issue Jun 28, 2024 · 0 comments

Comments

@Lumiond
Copy link

Lumiond commented Jun 28, 2024

Bug Report

Describe the bug
"Ignore older" setting doesn't work at runtime, only at start, after version 2.1.8.

To Reproduce

  • Steps to reproduce the problem:
  1. Set in_tail plugin to collect logs with Ignore_Older=1h
  2. Start fluent-bit

Expected behavior
After 2h of work Fluent-bit keeps open only current file and file from previous hour.

Screenshots
Clipboard - 20, 2024 11_01

Your Environment

  • Version used: 3.0.6
  • Configuration: build from source with kafka out plugin
  • Operating System and version: windows server 2019

Additional context
I noticed that Fluentbit doesn't release old log files, so I used the "Ignore older" setting to reduce the number of open files, because when I have around 1000 logs per 24h, Fluent-Bit uses a lot of RAM (more than 1 GB, which is a lot for an agent). Unfortunately I can't reduce the number of log files. After v2.1.8, this setting doesn't work at runtime.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant