You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
How was the Logstash Plugin installed: Dockerfile line: RUN ./bin/logstash-plugin install logstash-output-google_cloud_storage
OS version Linux kernel 4.14.174 (I believe the Docker image is based on CentOS)
Description of the problem including expected versus actual behavior:
Putting a / character in log_file_prefix (e.g. log_file_prefix => "my-prefix/") causes i/o to the temp_directory location to fail with errors like the following:
[2021-08-20T10:00:00.000][ERROR][logstash.javapipeline ][main] Pipeline aborted due to error {:pipeline_id=>"main", :exception=>#<Errno::ENOENT: No such file or directory - /tmp/logstash-gcs/my-prefix/logstash_gcs_cw054563.local_2021-08-20T10:00.part001.log.gz>, :backtrace=>["org/jruby/RubyIO.java:1239:in `sysopen'"
Presumably this is because it's trying to write a file into a subdirectory of temp_directory that doesn't exist yet, assuming that all temp files should be written to one flat directory, and uploaded to GCS as such as well. Similar symptoms arise when putting forward slashes in date_pattern.
Logstash information:
Please include the following information:
RUN ./bin/logstash-plugin install logstash-output-google_cloud_storage
OS version Linux kernel 4.14.174 (I believe the Docker image is based on CentOS)
Description of the problem including expected versus actual behavior:
Putting a
/
character inlog_file_prefix
(e.g.log_file_prefix => "my-prefix/"
) causes i/o to thetemp_directory
location to fail with errors like the following:Presumably this is because it's trying to write a file into a subdirectory of
temp_directory
that doesn't exist yet, assuming that all temp files should be written to one flat directory, and uploaded to GCS as such as well. Similar symptoms arise when putting forward slashes indate_pattern
.See #45 and #46 for further examples of this.
Steps to reproduce:
A pipeline to reproduce:
The text was updated successfully, but these errors were encountered: