Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

validate_credentials_on_root_bucket is ignored #258

Open
deepak5127 opened this issue Jun 15, 2023 · 0 comments
Open

validate_credentials_on_root_bucket is ignored #258

deepak5127 opened this issue Jun 15, 2023 · 0 comments
Labels

Comments

@deepak5127
Copy link

deepak5127 commented Jun 15, 2023

Logstash information:

Please include the following information:

  1. Logstash version = 7.7.1
  2. Logstash installation source = docker
  3. How is Logstash being run = docker
  4. How was the Logstash Plugin installed = installed via Docker build. RUN bin/logstash-plugin install --version 4.4.1 logstash-output-s3

JVM (e.g. java -version):

Bundled JVM

Description of the problem including expected versus actual behavior:

Steps to reproduce:

Configured something like this in output,

output {
if [@metadata][type] == 'FAILED_PROCESSING' {
s3 {
id => "id1"
bucket => "bucket_one"
prefix => "stat_action_outputs/%{+YYYY}/%{+MM}/%{+dd}/%{+HH}"
region => "aws region"
rotation_strategy => "size_and_time"
time_file => "5"
size_file => "10000"
codec => "json_lines"
encoding => "gzip"
tags => ["errors"]
temporary_directory => "location 1"
validate_credentials_on_root_bucket => false
}
} else {
s3{
id => "id2"
bucket => "bucket_two"
prefix => "json/%{+YYYY}/%{+MM}/%{+dd}"
region => "aws region"
rotation_strategy => "size_and_time"
time_file => "5"
size_file => "10000"
codec => "json_lines"
encoding => "gzip"
tags => ["normal"]
temporary_directory => "location 2"
validate_credentials_on_root_bucket => false
}
}
}

Getting error

Provide logs (if relevant):

[2023-06-13T09:02:05,290][ERROR][logstash.outputs.s3 ][pipeline_id] Error validating bucket write permissions! {:message=>"uninitialized constant Aws::S3::Object::FileUploader", :class=>"NameError", :backtrace=>["org/jruby/RubyModule.java:3760:in const_missing'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/aws-sdk-resources-2.11.475/lib/aws-sdk-resources/services/s3/object.rb:249:in upload_file'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-s3-4.4.1/lib/logstash/outputs/s3/write_bucket_permission_validator.rb:43:in upload_test_file'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-s3-4.4.1/lib/logstash/outputs/s3/write_bucket_permission_validator.rb:18:in valid?'", "/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-s3-4.4.1/lib/logstash/outputs/s3.rb:215:in register'", "org/logstash/config/ir/compiler/OutputStrategyExt.java:126:in register'", "org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:68:in register'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:216:in block in register_plugins'", "org/jruby/RubyArray.java:1809:in each'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:215:in register_plugins'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:520:in maybe_setup_out_plugins'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:228:in start_workers'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:170:in run'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:125:in block in start'"]}

[2023-06-13T09:02:05,294][ERROR][logstash.javapipeline ][pipeline_id] Pipeline aborted due to error {:pipeline_id=>"stat_aciton_outputs", :exception=>#<LogStash::ConfigurationError: Logstash must have the privileges to write to root bucket bucket_one, check your credentials or your permissions.>, :backtrace=>["/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-s3-4.4.1/lib/logstash/outputs/s3.rb:216:in register'", "org/logstash/config/ir/compiler/OutputStrategyExt.java:126:in register'", "org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:68:in register'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:216:in block in register_plugins'", "org/jruby/RubyArray.java:1809:in each'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:215:in register_plugins'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:520:in maybe_setup_out_plugins'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:228:in start_workers'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:170:in run'", "/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:125:in block in start'"], "pipeline.sources"=>["/usr/share/logstash/pipeline/stat_aciton_outputs.conf"], :thread=>"#<Thread:0x6e564c71 run>"}

@deepak5127 deepak5127 added the bug label Jun 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant