Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error with INPUT tail on Windows Server 2019 to monitor logs on network share drive #9042

Open
Kenifx opened this issue Jul 4, 2024 · 1 comment

Comments

@Kenifx
Copy link

Kenifx commented Jul 4, 2024

Bug Report

Hello All,

Describe the bug
When we use fluent bit to monitor logs from UNC or mapped network drive, it's throwing errors after log files are detected.
Same configuration works perfectly for log files on the local server.
There is no access issue or file existence issue. We made sure windows user running fluent bit has access to the remote path and files, and the files are not removed.

The remote network share drive can be a shared folder from other VM server, or Azure Storage File share - both of them are having the error after file is detected as shown below.

To Reproduce

[INPUT]
Name tail
#Z is mapped network drive where permission is no issue
Path Z:\My Docs*.txt
Tag botlog
Parser bot_log_parser

  • Rubular link if applicable:
  • Example log message if applicable:

[2024/07/03 22:42:17] [ info] [fluent bit] version=3.0.7, commit=73e72bdf9a, pid=9284
[2024/07/03 22:42:17] [debug] [engine] coroutine stack size: 98302 bytes (96.0K)
[2024/07/03 22:42:17] [ info] [storage] ver=1.5.2, type=memory, sync=normal, checksum=off, max_chunks_up=128
[2024/07/03 22:42:17] [ info] [cmetrics] version=0.9.1
[2024/07/03 22:42:17] [ info] [ctraces ] version=0.5.1
[2024/07/03 22:42:17] [ info] [input:tail:tail.0] initializing
[2024/07/03 22:42:17] [ info] [input:tail:tail.0] storage_strategy='memory' (memory only)
[2024/07/03 22:42:17] [debug] [tail:tail.0] created event channels: read=820 write=824
[2024/07/03 22:42:17] [debug] [input:tail:tail.0] flb_tail_fs_stat_init() initializing stat tail input
[2024/07/03 22:42:17] [debug] [input:tail:tail.0] inode=9367503187713458176 with offset=2116 appended as Z:\My Docs\Log_7_4_2024.txt
[2024/07/03 22:42:17] [debug] [input:tail:tail.0] 1 new files found on path 'Z:\My Docs\Log_7_4_2024.txt'

[2024/07/03 22:42:17] [debug] [file:file.0] created event channels: read=844 write=848
[2024/07/03 22:42:17] [debug] [stdout:stdout.1] created event channels: read=880 write=884
[2024/07/03 22:42:17] [debug] [router] match rule tail.0:file.0
[2024/07/03 22:42:17] [debug] [router] match rule tail.0:stdout.1
[2024/07/03 22:42:17] [ info] [sp] stream processor started
[2024/07/03 22:42:17] [ info] [output:stdout:stdout.1] worker #0 started
[2024/07/03 22:42:17] [ info] [output:file:file.0] worker #0 started
[2024/07/03 22:42:17] [debug] [input:tail:tail.0] inode=9367503187713458176 file=Z:\My Docs\Log_7_4_2024.txt promote to TAIL_EVENT
[2024/07/03 22:42:17] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:17] [debug] [input:tail:tail.0] [static files] processed 0b, done
[2024/07/03 22:42:20] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:22] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:25] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:27] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:30] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:32] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:35] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:37] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:40] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory
[2024/07/03 22:42:42] [error] [D:\a\fluent-bit\fluent-bit\plugins\in_tail\tail_file.c:1639 errno=2] No such file or directory

[2024/07/03 22:42:42] [ warn] [engine] service will shutdown in max 5 seconds
[2024/07/03 22:42:42] [ info] [input] pausing tail.0
[2024/07/03 22:42:43] [ info] [engine] service has stopped (0 pending tasks)
[2024/07/03 22:42:43] [ info] [input] pausing tail.0
[2024/07/03 22:42:43] [ info] [output:file:file.0] thread worker #0 stopping...
[2024/07/03 22:42:43] [debug] [input:tail:tail.0] inode=9367503187713458176 removing file name Z:\My Docs\Log_7_4_2024.txt
[2024/07/03 22:42:43] [ info] [output:file:file.0] thread worker #0 stopped
[2024/07/03 22:42:43] [ info] [output:stdout:stdout.1] thread worker #0 stopping...
[2024/07/03 22:42:43] [ info] [output:stdout:stdout.1] thread worker #0 stopped

- Steps to reproduce the problem:

**Expected behavior**
When log files are detected, fluent bit should send the logs to required OUTPUT instead of throwing above error saying no such file or directory.


**Your Environment**
<!--- Include as many relevant details about the environment you experienced the bug in -->
* Version used: fluent bit 3.0.7
* Operating System and version: Windows server 2019



If any further info is required, please let me know. Thank you.
@Kenifx
Copy link
Author

Kenifx commented Jul 4, 2024

There was one issue reported very similar to the error I encountered, but error was from a different line.
#7220

@Kenifx Kenifx closed this as completed Jul 4, 2024
@Kenifx Kenifx reopened this Jul 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant