"Internal data stream error" when streaming from (4K)RTSP source

[gijsbeijer]

Hi,

When using the docker rtsp gstreamer sample I can stream to Kinesis, this works even with a high frame-rate and bitrate. But as soon as my resolution hits: 3840x2160 I get an "Internal data stream error". below is the part of the log where you can see the error and I'll add a full (level 4) log as wel

ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:38:273.810 GMT] streamReadyHandler invoked
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:38:274.034 GMT] Stream is ready
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:41:111.514 GMT] Streaming from rtsp source
ocuma-rtsp_stream-1  | New pad found: recv_rtp_src_1_850571346_97
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:241.567 GMT] Pad link failed
ocuma-rtsp_stream-1  | New pad found: recv_rtp_src_0_2131242549_96
ocuma-rtsp_stream-1  | Error received from element udpsrc1: Internal data stream error.
ocuma-rtsp_stream-1  | Debugging information: gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:rtsp-kinesis-pipeline/GstRTSPSrc:source/GstUDPSrc:udpsrc1:
ocuma-rtsp_stream-1  | streaming stopped, reason not-linked (-1)
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:325.066 GMT] Pad link failed
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:338.541 GMT] stopKinesisVideoStreamSync(): Synchronously stopping Kinesis Video Stream 00000055c808d890.
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:42:338.744 GMT] streamClosedHandler invoked for upload handle: 18446744073709551615
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:338.859 GMT] Freeing Kinesis Video Stream for MVP_STREAM
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:338.947 GMT] freeKinesisVideoStream(): Freeing Kinesis Video stream.
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:42:339.001 GMT] freeStream(): [MVP_STREAM] Freeing stream
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:42:339.072 GMT] curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:42:739.639 GMT] freeStream(): [MVP_STREAM] Completed freeing stream
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:739.959 GMT] Freeing Kinesis Video Stream for MVP_STREAM
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:42:740.131 GMT] freeKinesisVideoClient(): Freeing Kinesis Video Client
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:42:740.253 GMT] curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
ocuma-rtsp_stream-1  | [DEBUG] [04-10-2023 09:33:43:140.932 GMT] freeKinesisVideoClientInternal(): Total allocated memory 0
ocuma-rtsp_stream-1  | [INFO ] [04-10-2023 09:33:43:141.134 GMT] Completed freeing client
ocuma-rtsp_stream-1  | [WARN ] [04-10-2023 09:33:43:141.267 GMT] curlApiCallbacksShutdown(): curlApiCallbacksShutdown called when already in progress of shutting down

level 4 log.txt

Can anybody tell me how to fix/debug this?

Regards Gijs

[niyatim23]

Hi @gijsbeijer, I see pad link failure in the logs shared:

[INFO ] [04-10-2023 14:39:46:920.972 GMT] Streaming from rtsp source
New pad found: recv_rtp_src_1_1315363468_97
[INFO ] [04-10-2023 14:39:48:025.044 GMT] Pad link failed
New pad found: recv_rtp_src_0_366790105_96
[INFO ] [04-10-2023 14:39:48:027.566 GMT] Pad link failed

This is originating in GStreamer and not KVS. Can you shared the GStreamer pipeline you are using? Also, if you're using kvssink, try using appsink or filesink to rule out KVS related issues

[gijsbeijer]

Hi thanks for your reply!

I'm using the docker sample as is.

I am not a cpp developer but on the file https://github.com/awslabs/amazon-kinesis-video-streams-producer-sdk-cpp/blob/master/samples/kvs_gstreamer_sample.cpp at line 963 it is creating a variable called appsink, so I guess that is what it is using. Should I try another one? would that be as easy as replacing all occurences of 'appsink' with 'filesink'?

I also tried to debug gstreamer, but I couldn't find anything on why it wouldn't be able or would be limited to a specific resolution. If you would have any thoughts on this, this would also be highly appreciated!

Regards Gijs