You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi team, I have a query regarding how to configure mem_buf_limit to handle backpressure when logstash is not available. The issue was identified when fluetbit stopped with OOM kill issue when container memory limit was set to 30 Mi and logstash was not available for longer time. Increased container memory and verified with different log input rate. Based on the test result observed below behavior when mem_buf_limit is set to 1MB
1log/sec ------> could observe restart after longer time
100log/sec -----> restart didn't happen
200log/sec ------> restart didn't happen
Analysis - If mem_buf_limit is not filled then while harvesting logs fluentbit is consuming more memory. When mem_limit is reached there is not much variation in container memory (mostly 3 to 4 Mi increase after overlimit happens).
Question: It would be great if there is some way to figure out mem_buf_limit value. Thanks in advance!
Bug Report
Describe the bug
Hi team, I have a query regarding how to configure mem_buf_limit to handle backpressure when logstash is not available. The issue was identified when fluetbit stopped with OOM kill issue when container memory limit was set to 30 Mi and logstash was not available for longer time. Increased container memory and verified with different log input rate. Based on the test result observed below behavior when mem_buf_limit is set to 1MB
1log/sec ------> could observe restart after longer time
100log/sec -----> restart didn't happen
200log/sec ------> restart didn't happen
Analysis - If mem_buf_limit is not filled then while harvesting logs fluentbit is consuming more memory. When mem_limit is reached there is not much variation in container memory (mostly 3 to 4 Mi increase after overlimit happens).
Question: It would be great if there is some way to figure out mem_buf_limit value. Thanks in advance!
To Reproduce
Expected behavior
Screenshots
Your Environment
Additional context
The text was updated successfully, but these errors were encountered: