You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I use OpenTelemetry Collector Contrib with exporters to AWS S3 with otlp_proto, data formated as ExportLogsServiceRequest. Then I use vector AWS S3 to read from S3 with SQS event and copy proto event to Kafka.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I everyone
I use OpenTelemetry Collector Contrib with exporters to AWS S3 with otlp_proto, data formated as ExportLogsServiceRequest. Then I use vector AWS S3 to read from S3 with SQS event and copy proto event to Kafka.
First. I create desc file from
https://github.com/open-telemetry/opentelemetry-proto/blob/main/opentelemetry/proto/collector/logs/v1/logs_service.proto#L36
and try to decode successfully
and this i my vector config
But error are show as below
2024-06-23T18:21:27.647922Z ERROR source{component_kind="source" component_id=s3_logs component_type=aws_s3}: vector::internal_events::codecs: Failed deserializing frame. error=Error parsing protobuf: DecodeError { description: "unexpected end group tag", stack: [] } error_code="decoder_deserialize" error_type="parser_failed" stage="processing" internal_log_rate_limit=true
2024-06-23T18:21:27.648015Z ERROR source{component_kind="source" component_id=s3_logs component_type=aws_s3}: vector::internal_events::codecs: Internal log [Failed deserializing frame.] is being suppressed to avoid flooding.
2024-06-23T18:21:37.648059Z ERROR source{component_kind="source" component_id=s3_logs component_type=aws_s3}: vector::internal_events::codecs: Internal log [Failed deserializing frame.] has been suppressed 923297 times.
2024-06-23T18:21:37.648085Z ERROR source{component_kind="source" component_id=s3_logs component_type=aws_s3}: vector::internal_events::codecs: Failed deserializing frame. error=Error parsing protobuf: DecodeError { description: "unexpected end group tag", stack: [] } error_code="decoder_deserialize" error_type="parser_failed" stage="processing" internal_log_rate_limit=true
Does vector support to transfer OpenTelemetry Protobuf message to Kafka ? Is my configuration wrong ?
Thank
Beta Was this translation helpful? Give feedback.
All reactions