Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upload_queue_size doesnt do anything #225

Open
marielcherkassky opened this issue Jun 3, 2020 · 0 comments
Open

upload_queue_size doesnt do anything #225

marielcherkassky opened this issue Jun 3, 2020 · 0 comments

Comments

@marielcherkassky
Copy link

Hey,
I was trying to upload to s3 each message that I get from my input without doing any aggregation.
Maybe I got it wrong but according to the docs upload_queue_size sounds fit for this issue - Number of items we can keep in the local queue before uploading them.

The output pipeline I configured :

output {
  s3 {
    region => "eu-east-1"
    bucket => "my_bucket"
    upload_queue_size => 1
    prefix => "files/"
    temporary_directory => "/etc/logstash/tmp_files_to_s3"
  }
  file {
     codec => rubydebug
     path => "/tmp/monitor.log"
  }
}

By default the rotation_strategy is configured to time or size thresholds. So I dont see how it behaves together with the upload_queue_size when it is configured.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant