[Support]: Main stream is lost / not recorded during events, but preview stream is still recorded

[DanGamingTV]

Checklist

• I have updated to the latest available Frigate version.
• I have cleared the cache of my browser.
• I have tried a different browser to see if it is related to my browser.
• I have tried reproducing the issue in incognito mode to rule out problems with any third party extensions or plugins I have installed.

Describe the problem you are having

Whenever something happens in front of my cameras that is likely an event (e.g. person, car), the footage from the main stream disappears over the duration of that event when looking back in the Review Tab. However, when scrubbing over when the event took place, the preview thumbnail shows recorded footage of the event from the detect stream.
Otherwise (when no detectable objects are in view of the camera), the main stream is recorded continuously and is accessible through the Review Tab.

VIDEO: https://youtu.be/su0fUMobSGU
Description of what's going on the video:
When I scrub over the timeline during an event (the person moving in frame), I can see the preview that was recorded from the detect stream. However, when I release the playhead during that event, the playhead skips to the end of the event / detection. No footage is recorded from the main stream during the event.

This isn't consistent, there have been other times where events from the same camera have recorded perfectly fine on both the main stream and the detect stream:

Steps to reproduce

1. Set up the recording config as follows:

record:
  enabled: true
  retain:
    days: 7
    mode: all
  events:
    pre_capture: 25
    post_capture: 20
    retain:
      default: 31
      mode: all

2. Add a Reolink Duo series (Duo 2 PoE or Floodlight PoE) camera to Frigate
3. Start Frigate and ensure that there are no detectable objects in view of the camera. Allow Frigate to record the main stream from the camera for however long you like to ensure that continuous recording works.
4. Put an object in view of the camera so Frigate can detect it. (e.g. walk in front of the camera)
5. Take the object out of view of the camera
6. Wait a few minutes
7. Visit the Frigate Web UI, click on the camera in the Live Tab, then click the History button in the top left of the screen.
8. Scrub to the approximate time of you putting the object in view of the camera, and attempt to play footage from this time period.
9. Scrub backwards and forwards during the event and check if there is a preview of the event (from the detect stream) displayed.
   ...

Version

0.14.1-f4f3cfa

In which browser(s) are you experiencing the issue with?

Version 125.0.6422.141 (Official Build, ungoogled-chromium) (64-bit)

Frigate config file

mqtt:
  enabled: false

detectors:
  tensorrt:
    type: tensorrt
    device: 0 #This is the default, select the first GPU

record:
  enabled: true
  retain:
    days: 7
    mode: all
  events:
    pre_capture: 25
    post_capture: 20
    retain:
      default: 31
      mode: all

snapshots:
  enabled: true
  timestamp: false
  bounding_box: true
  retain:
    default: 10

logger:
  logs:
    frigate.record.maintainer: debug



model:
  path: /config/model_cache/tensorrt/yolov7-320.trt
  input_tensor: nchw
  input_pixel_format: rgb
  width: 320
  height: 320

# objects:
#   track:
#     - person
#     - cat
#     - bicycle
#     - dog
#     - car

cameras:
  camera1:
    enabled: true
    ui:
      order: 4
    detect:
      width: 640
      height: 480
      fps: 5
    objects:
      track:
        - person
        - cat
        - bicycle
        - dog
    ffmpeg:
      #input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
      #  tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          # input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
        - path: rtsp://username:[email protected]/Preview_01_main
          # input_args: preset-rtsp-restream
          roles:
            - record
    motion:
      mask: 0.007,0.055,0.304,0.051,0.306,0,0.006,0.008

  camera2:
    enabled: true
    ui:
      order: 0
    review:
      alerts:
        required_zones:
          - RDF1_OurProperty
    detect:
      width: 1536
      height: 576
      fps: 5
    objects:
      track:
        - person
        - cat
        - bicycle
        - dog
        - car
      filters:
        car:
          mask:
            - 0.999,0.589,0.998,0.005,0.478,0.002,0.484,0.166,0.509,0.186,0.534,0.161,0.602,0.127,0.665,0.181,0.691,0.193,0.714,0.215,0.746,0.274,0.797,0.367,0.808,0.399,0.833,0.421,0.922,0.482,0.964,0.516
            - 0,0.478,0,0.681,0.134,0.975,0.148,0.789,0.076,0.536,0.31,0.147,0.46,0.015,0.001,0.002
        person:
          mask: 0,0.573,0.038,0.567,0.035,0.785,0,0.776
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
        tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
            #- record
        - path: rtsp://username:[email protected]/Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record

    motion:
      mask:
        - 0.181,0.017,0.205,0.017,0.206,0.07,0.18,0.068
        - 0.999,0.589,0.938,0.494,0.847,0.425,0.813,0.364,0.761,0.264,0.74,0.252,0.711,0.208,0.678,0.181,0.644,0.154,0.603,0.122,0.555,0.152,0.51,0.193,0.481,0.169,0.478,0.105,0.516,0.098,0.544,0.09,0.526,0.061,0.528,0.024,0.553,0,0.999,0.002
    zones:
      RDF1_OurProperty:
        coordinates: 
          0,0.472,0.063,0.362,0.18,0.215,0.25,0.13,0.349,0.02,0.402,0.007,0.461,0,0.464,0.169,0.509,0.23,0.603,0.173,0.638,0.208,0.668,0.239,0.689,0.237,0.713,0.283,0.732,0.317,0.759,0.361,0.795,0.455,0.826,0.515,0.912,0.579,0.942,0.605,0.98,0.655,1,0.642,0.999,0.995,0,0.995
        inertia: 3
  camera3_problem_camera:
    enabled: true
    ui:
      order: 1
    detect:
      width: 1536
      height: 576
      fps: 5
    objects:
      track:
        - person
        - cat
        - bicycle
        - dog
      filters:
        car:
          mask: 
            0.001,0.462,0.049,0.383,0.038,0.337,0.111,0.128,0.124,0.294,0.144,0.375,0.129,0.398,0.107,0.356,0.009,0.507
        bicycle:
          mask: 0.324,0.374,0.336,0.357,0.349,0.399,0.342,0.435,0.318,0.438
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
        tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
            #- record
        - path: rtsp://username:[email protected]/Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record
    motion:
      mask:
        - 0.178,0.015,0.204,0.015,0.205,0.066,0.179,0.062
        - 0.112,0.133,0.037,0.337,0.046,0.375,0.001,0.464,0.007,0.505,0.106,0.36,0.128,0.402,0.144,0.381,0.123,0.296
        - 0.57,0.037,0.629,0.112,0.692,0.191,0.72,0.24,0.819,0.362,0.907,0.528,0.997,0.66,0.999,0.012,0.592,0.005
  camera4:
    enabled: true
    ui:
      order: 3
    detect:
      width: 1536
      height: 576
      fps: 5
    objects:
      track:
        - person
        - cat
        - bicycle
        - dog
      filters:
        person:
          mask:
            - 0.155,0.006,0.132,0.308,0.001,0.515,0,0
            - 0.247,0.25,0.269,0.246,0.275,0.335,0.247,0.352
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
        tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
            #- record
        - path: rtsp://username:[email protected]/Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record
    motion:
      mask:
        - 0.809,0.387,0.83,0.389,0.83,0.441,0.806,0.66,0.78,0.648
        - 0.18,0.01,0.209,0,0.209,0.068,0.177,0.064
  camera5:
    enabled: true
    ui:
      order: 2
    detect:
      width: 1536
      height: 576
      fps: 5
    review:
      alerts:
        required_zones:
          - RD2_1_OurProperty
    objects:
      track:
        - person
        - cat
        - bicycle
        - dog
        - car
      filters:
        car:
          mask: 
            0.729,0.259,0.756,0.238,0.792,0.304,0.81,0.285,0.826,0.308,0.878,0.395,0.898,0.304,0.803,0.19,0.742,0.112,0.685,0.046,0.635,0.002,0.585,0.002,0.58,0.05,0.618,0.064,0.711,0.116,0.73,0.137,0.716,0.217
        person:
          mask: 0.185,0.658,0.086,0.273,0.115,0.217,0.216,0.625,0.203,0.673
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
        tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
            #- record
        - path: rtsp://username:[email protected]/Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record

    motion:
      mask:
        - 0.207,0.017,0.146,0.015,0.147,0.058,0.21,0.064
        - 0.878,0.394,0.806,0.276,0.793,0.302,0.756,0.236,0.73,0.258,0.716,0.219,0.73,0.136,0.706,0.112,0.581,0.044,0.585,0.004,0.639,0.002,0.683,0.037,0.798,0.182,0.898,0.302

    zones:
      RD2_1_OurProperty:
        coordinates: 
          0.149,0,0.094,0.132,0.18,0.106,0.181,0.153,0.119,0.222,0.133,0.275,0.184,0.203,0.236,0.149,0.297,0.085,0.355,0.044,0.418,0.015,0.468,0.008,0.511,0.004,0.542,0.019,0.584,0.039,0.631,0.058,0.687,0.087,0.73,0.13,0.721,0.199,0.766,0.248,0.786,0.28,0.795,0.309,0.806,0.282,0.843,0.333,0.88,0.397,0.888,0.348,0.929,0.329,0.955,0.373,0.912,0.242,0.885,0.161,0.854,0.079,0.82,0.002,0.999,0.002,1,1,0,1,0,0

  camera6:
    enabled: true
    ui:
      order: 5
    detect:
      width: 1536
      height: 576
      fps: 5
    objects:
      track:
        - person
        - cat
        - dog
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
        tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
            #- record
        - path: rtsp://username:[email protected]/Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record

  camera7:
    enabled: false
    detect:
      width: 896
      height: 512
      fps: 5
    ffmpeg:
      input_args: -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport
        tcp -stimeout 5000000 -use_wallclock_as_timestamps 1
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://username:[email protected]/Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
            #- record
        - path: rtsp://username:[email protected]/Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record
version: 0.14

docker-compose file or Docker CLI command

Not sure where to get this from, used Unraid CA to install.

Relevant Frigate log output

Debug
2024-12-19 00:49:17
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo2_1/49.07.mp4 in 0.08451008796691895 seconds.
Debug
2024-12-19 00:49:17
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_510a_xxxx/49.06.mp4 in 0.08419299125671387 seconds.
Debug
2024-12-19 00:49:22
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo_floodlight_1/49.07.mp4 in 0.026401996612548828 seconds.
Debug
2024-12-19 00:49:22
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo_floodlight_3/49.07.mp4 in 0.040112972259521484 seconds.
Debug
2024-12-19 00:49:27
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo_floodlight_3/49.17.mp4 in 0.11835694313049316 seconds.
Debug
2024-12-19 00:49:27
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo2_1/49.16.mp4 in 0.03377699851989746 seconds.
Debug
2024-12-19 00:49:27
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo_floodlight_2/49.16.mp4 in 0.04502511024475098 seconds.
Debug
2024-12-19 00:49:27
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_510a_xxxx/49.17.mp4 in 0.08750319480895996 seconds.
Debug
2024-12-19 00:49:32
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo_floodlight_1/49.17.mp4 in 0.026498794555664062 seconds.
Debug
2024-12-19 00:49:32
frigate.record.maintainer
Copied /media/frigate/recordings/2024-12-18/11/reo_duo2_2_xxxx/49.17.mp4 in 0.02251911163330078 seconds.

PS: I'll work to re-produce this issue and capture the logs, without all this debug info. In my past experience with this issue no logs get produced during the event, only after when I try to create an export covering the time period of the event.

Relevant go2rtc log output

Not using go2rtc.

Operating system

UNRAID

Install method

Docker Compose

Network connection

Wired

Camera make and model

Reolink Duo 2 PoE, Reolink Duo Floodlight PoE

Screenshots of the Frigate UI's System metrics pages

Note: these screenshots were taken well after the issue demonstrated in the attached video. Screenshots taken around 1 AM local time, a baseline for when there is no objects being detected on any cameras.

Any other information that may be helpful

Frigate recordings are stored on a Crucial M.2 SSD, which is blazing fast, so there isn't a bottleneck here.

I am using the highest possible bitrate on the main stream from my Reolink cameras:

Screenshot of Netdata logs on the Frigate Docker Container just before and after one of these events starting (and stopping the main stream recording):

Unraid System Specs:
Motherboard: ASUS PRIME H770-PLUS D4
CPU: i5-12400F
RAM: 64GB (4 x 16GB G-Skill DDR4 Modules)
Networking: Onboard 2.5G Ethernet, connected to a 2.5G switch. 2.5G switch is connected to Gigabit PoE switch which connects to and powers the cameras.

Docker Image ID: 6cfe5e8b16e1 ghcr.io/blakeblackshear/frigate:0.14.0-beta4-tensorrt

NOTE!

I do apologise for not providing logs + screenshots from System Pages DURING this issue happening, just wanting to see if anyone else has had this issue before and may know a cause / fix. I'll work to reproduce this error with proper logs soon!

[NickM-27]

Are the recordings you're viewing after the 7 days? All recordings should be kept for 7 days so if they're not then that's likely going to be a camera issue.

[hawkeye217]

Along with what @NickM-27 said, you'll want to double check your input_args. You're using a preset designed for use with go2rtc.

We'll need to see logs to be able to help further as well.

[DanGamingTV]

The footage I was viewing in the first example was within the past 7 days.
I changed my input_args to use the generic rtsp preset.
New config
I observed the issue happening again: Video
There were no logs created during the event.
I am noticing that this skipping only happens when there are at least two objects in frame (e.g a person and a car).

Netdata screenshots during the event:

[NickM-27]

Not able to watch the video. Also, I'd suggest checking the recordings folders directly for the time to see if any time is missing (remember folders are in UTC)

[DanGamingTV]

Apologies, the video link should work now. Here's the files in the recordings folder for that camera during that event:

There are 346 total video files in this folder, which is less than the 360 I'd expect it to be around (360 x 10 second segments per hour).

Here's what happens when I attempt to export this event:


Only 1 second of video gets exported.
And oddly, there is no error log saying that footage was missing when doing the export:

[NickM-27]

Okay, so we can see in the files there is a large gap where you'd expect to see this occurring, so the recordings were not saved.

At this point I think I would suggest updating to 0.15-beta4 as we have reworked some of the recording retention logic and I'd rather see if this still occurs in that version.