How to add audio to stream using .m3u h264/aac rtspsrc

[itsmeaksingh]

Hi,

I have used the following command for streaming..

gst-launch-1.0 -v rtspsrc location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=TRUE ! rtph264depay ! h264parse ! kvssink access-key= secret-key= stream-name="ExampleStream" storage-size=512

And my streaming is successfully displayed on the AWS kinesis-video-streams but i want to listen my audio too. but noting work for me, For audio purpose i have used this command

gst-launch-1.0 -v rtspsrc location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=TRUE ! rtph264depay ! h264parse ! kvssink access-key= secret-key= stream-name="ExampleStream" storage-size=512 alsasrc device=hw:1,0 ! audioconvert ! avenc_aac ! queue ! sink.

can enyone help so i can stream my audio and video.

[hassanctech]

If you're receiving audio and video from RTSP you will need to split the pipeline and have depayer for h264 as well as for the audio (for example: https://gstreamer.freedesktop.org/documentation/rtp/rtpac3depay.html?gi-language=c), then you need to mux these together to a single stream and then send to kvssink.

Here's and example from someone else who tried to do this, if you follow this it should work for you! If it does not please re-open: #687 (comment)

[itsmeaksingh]

Hi,

i have check all the solution but nothing worked for me,

Live RTSP link: rtsp://192.168.68.114:5554/playlist.m3u

Working without audio

gst-launch-1.0 -v rtspsrc location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=TRUE ! rtph264depay ! h264parse ! kvssink access-key="access-key" secret-key="secret-key" stream-name="ExampleStream" storage-size=512

----- For audio purose used commands:

First command for audio # not working

gst-launch-1.0 rtspsrc name=src location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=true ! rtph264depay ! h264parse ! kvssink name=sink access-key="access-key" secret-key="secret-key" stream-name="ExampleStream" storage-size=1024 aws-region="us-east-2" frame-timecodes=false src. ! rtppcmadepay ! alawdec ! audioresample ! audioconvert ! voaacenc ! aacparse ! queue ! sink.

Second command for audio # not working

gst-launch-1.0 rtspsrc name=src location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=true ! rtph264depay ! h264parse ! kvssink name=sink access-key="access-key" secret-key="secret-key" stream-name="ExampleStream" storage-size=1024 aws-region="us-east-2" frame-timecodes=false src. ! rtpmpadepay ! mpg123audiodec ! audioresample ! audioconvert ! voaacenc ! aacparse ! queue ! sink.

third command for audio # not working

gst-launch-1.0 rtspsrc name=src location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=true ! rtph264depay ! h264parse ! kvssink name=sink access-key="access-key" secret-key="secret-key" stream-name="ExampleStream" storage-size=1024 aws-region="us-east-2" frame-timecodes=false src. ! rtpaacdepay ! queue ! sink.

Can you please re-open this issue!

Thanks

[itsmeaksingh]

Hi,

Video:
Codec: h264
Resolution: 852 X 480
Bitrate: 1083 kbps VBR

Audio:
Codec: aac stereo
Sample rate: 48000
Bitrate: 67 kbps VBR

I have using these configuration for my rtsp but my audio is not coming on aws kinesis-video-stream. I don't know much about gst-launch-1.0 library, can you please share with me complete command.

Thanks

[javieralcantara]

Having the same issue here. Did anyone solve it?

[jdelapla]

Hello, this is a pure gstreamer issue unrelated to the internals of kvssink. Your pads aren't connecting between your rtspsrc and rtpPCMAdepay elements.

Please add a queue element between your src and rtpXXXXdepay(s) when doing a tee like this.

gst-launch-1.0 rtspsrc name=src location="rtsp://192.168.68.114:5554/playlist.m3u" short-header=true ! queue ! rtph264depay ! h264parse ! kvssink name=sink access-key="access-key" secret-key="secret-key" stream-name="ExampleStream" storage-size=1024 aws-region="us-east-2" frame-timecodes=false src. ! queue ! rtppcmadepay ! alawdec ! audioresample ! audioconvert ! voaacenc ! aacparse ! queue ! sink.

Something like that should work.
Very similar to this issue someone had with a/v pipelines.
awslabs/amazon-kinesis-video-streams-webrtc-sdk-c#1014

[jdelapla]

OR your audio codec isn't compatible with rtppcmadepay and you need to select a different depayer.

[javieralcantara]

I tried the command @jdelapla suggested without luck. The codec is set to AAC on the camera side.

Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://xxx:xxxxxxxxxx:554
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (request) SETUP stream 1
Progress: (open) Opened Stream
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
WARNING: from element /GstPipeline:pipeline0/GstRTSPSrc:src: Could not read from resource.
Additional debug info:
gstrtspsrc.c(5280): gst_rtspsrc_loop_udp (): /GstPipeline:pipeline0/GstRTSPSrc:src:
The server closed the connection.
WARNING: from element /GstPipeline:pipeline0/GstRTSPSrc:src: Could not read from resource.
Additional debug info:
gstrtspsrc.c(5427): gst_rtspsrc_reconnect (): /GstPipeline:pipeline0/GstRTSPSrc:src:
Could not receive any UDP packets for 5.0000 seconds, maybe your firewall is blocking it. Retrying using a tcp connection.
WARNING: from element /GstPipeline:pipeline0/GstRTSPSrc:src: Delayed linking failed.
Additional debug info:
./grammar.y(510): gst_parse_no_more_pads (): /GstPipeline:pipeline0/GstRTSPSrc:src:
failed delayed linking some pad of GstRTSPSrc named src to some pad of GstQueue named queue1
[INFO ] [23-02-2023 18:09:24:409.714 GMT] kinesisVideoStreamFormatChanged(): Stream format changed.

[jdelapla]

You would have to change the rtspsrc location to an rtspsrc location you know is providing a stream. Your rtspsrc error is stating it's not receiving any packets.

[javieralcantara]

No, that RTSP stream definitely exists. I can get video out of it using FFMPEG but not using gst-launch.

[hassanctech]

If you're using aac audio the depayer you're looking for is this one:

rtp:  rtpmp4adepay: RTP MPEG4 audio depayloader

[javieralcantara]

Please could you provide an example? I am trying this but I keep getting an error.

Working example without audio:

AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY AWS_DEFAULT_REGION=$AWS_REGION gst-launch-1.0 rtspsrc location=$STREAM_URL ! rtph264depay ! h264parse ! kvssink stream-name="LATEST_TEST" storage-size=512**

Not working with audio:

AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY AWS_DEFAULT_REGION=$AWS_REGION gst-launch-1.0 rtspsrc name=src location=$STREAM_URL short-header=true ! queue ! rtph264depay ! h264parse ! kvssink name=sink stream-name="ExampleStream" storage-size=1024 frame-timecodes=false src. ! queue ! rtppcmadepay ! alawdec ! audioresample ! audioconvert ! voaacenc ! aacparse ! queue ! sink.

Error:

WARNING: from element /GstPipeline:pipeline0/GstRTSPSrc:src: Delayed linking failed.
Additional debug info:
./grammar.y(506): gst_parse_no_more_pads (): /GstPipeline:pipeline0/GstRTSPSrc:src:
failed delayed linking some pad of GstRTSPSrc named src to some pad of GstQueue named queue1
[INFO ] [27-02-2023 20:10:32:069.168 GMT] kinesisVideoStreamFormatChanged(): Stream format changed.

[javieralcantara]

Okay the command bellow seems to work but it really does not. I get error code 0x52000085 after a few seconds.

gst-launch-1.0 rtspsrc name=src location=$STREAM_URL short-header=true ! queue ! rtph264depay ! h264parse ! kvssink name=sink stream-name="ExampleStream" storage-size=1024 frame-timecodes=false src. ! queue ! rtpmp4gdepay ! aacparse ! queue ! sink.

According to this there is an encoder issue. This is where I get lost. Anyone with experience know what is going on?