NvEnc: encoding format is not supported by the gpu

[LIUMNBC]

Is there an existing issue for this?

• I have searched the existing issues

Is your issue described in the documentation?

• I have read the documentation

Is your issue present in the latest beta/pre-release?

• This issue is present in the latest pre-release

Describe the Bug

Expected Behavior

Sunshine can be started normally, but an error will be reported, and the sunshine window will always exist.

Additional Context

No response

Host Operating System

Windows

Operating System Version

21h2

Architecture

64 bit

Sunshine commit or version

0.23.1

Package

Windows - portable

GPU Type

Nvidia

GPU Model

NVIDIA GeForce RTX 3060 Laptop GPU

GPU Driver/Mesa Version

526.98

Capture Method (Linux Only)

No response

Config

locale = zh

Apps

{
  "env": {},
  "apps": [
    {
      "name": "Desktop",
      "image-path": "desktop.png"
    },
    {
      "name": "Steam Big Picture",
      "cmd": "steam://open/bigpicture",
      "auto-detach": "true",
      "wait-all": "true",
      "image-path": "steam.png"
    }
  ]
}

Relevant log output

[locale] -- [zh]
[2024:06:03:22:13:22]: Info: Sunshine version: v0.23.1
[2024:06:03:22:13:22]: Info: nvprefs: Opened undo file from previous improper termination
[2024:06:03:22:13:22]: Info: nvprefs: Restored OGL_CPL_PREFER_DXPRESENT for base profile
[2024:06:03:22:13:22]: Info: nvprefs: Restored global profile settings from undo file - deleting the file
[2024:06:03:22:13:22]: Info: nvprefs: No need to modify application profile settings
[2024:06:03:22:13:22]: Info: nvprefs: Changed OGL_CPL_PREFER_DXPRESENT to OGL_CPL_PREFER_DXPRESENT_PREFER_ENABLED for base profile
[2024:06:03:22:13:22]: Info: Compiling shaders...
[2024:06:03:22:13:22]: Info: Compiled shaders
[2024:06:03:22:13:22]: Info: System tray created
[2024:06:03:22:13:22]: Fatal: ViGEmBus is not installed or running. You must install ViGEmBus for gamepad support!
[2024:06:03:22:13:22]: Info: // Testing for available encoders, this may generate errors. You can safely ignore those errors. //
[2024:06:03:22:13:22]: Info: Trying encoder [nvenc]
[2024:06:03:22:13:22]: Info: ddprobe.exe [1] [] returned: 0x887A0004
[2024:06:03:22:13:22]: Info: ddprobe.exe [2] [] returned: 0x00000000
[2024:06:03:22:13:22]: Info: Set GPU preference: 2
[2024:06:03:22:13:22]: Error: Failed to sync desktop to thread [0x000000AA]
[2024:06:03:22:13:22]: Info:
Device Description : NVIDIA GeForce RTX 3060 Laptop GPU
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00002560
Device Video Mem   : 6009 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 8057 MiB
Feature Level      : 0x0000B100
Capture size       : 2560x1440
Offset             : 0x0
Virtual Desktop    : 2560x1440
[2024:06:03:22:13:22]: Info: Active GPU has HAGS disabled
[2024:06:03:22:13:22]: Info: Using realtime GPU priority
[2024:06:03:22:13:22]: Error: Failed to sync desktop to thread [0x000000AA]
[2024:06:03:22:13:22]: Info: Desktop resolution [2560x1440]
[2024:06:03:22:13:22]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2024:06:03:22:13:22]: Info: Display refresh rate [164.998Hz]
[2024:06:03:22:13:22]: Info: Requested frame rate [60fps]
[2024:06:03:22:13:22]: Info:
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.6875,0.308594]
Green Primary      : [0.265625,0.665039]
Blue Primary       : [0.148438,0.046875]
White Point        : [0.313477,0.329102]
Min Luminance      : 0.0004 nits
Max Luminance      : 301.849 nits
Max Full Luminance : 243.056 nits
[2024:06:03:22:13:22]: Info: SDR color coding [Rec. 601]
[2024:06:03:22:13:22]: Info: Color depth: 8-bit
[2024:06:03:22:13:22]: Info: Color range: [JPEG]
[2024:06:03:22:13:22]: Info: NvEnc: created encoder P1 two-pass rfi
[2024:06:03:22:13:22]: Info: SDR color coding [Rec. 601]
[2024:06:03:22:13:22]: Info: Color depth: 8-bit
[2024:06:03:22:13:22]: Info: Color range: [JPEG]
[2024:06:03:22:13:22]: Info: NvEnc: created encoder P1 two-pass rfi
[2024:06:03:22:13:22]: Info: SDR color coding [Rec. 601]
[2024:06:03:22:13:22]: Info: Color depth: 8-bit
[2024:06:03:22:13:22]: Info: Color range: [JPEG]
[2024:06:03:22:13:22]: Error: NvEnc: encoding format is not supported by the gpu
[2024:06:03:22:13:22]: Error: Failed to sync desktop to thread [0x000000AA]
[2024:06:03:22:13:22]: Info:
Device Description : NVIDIA GeForce RTX 3060 Laptop GPU
Device Vendor ID   : 0x000010DE
Device Device ID   : 0x00002560
Device Video Mem   : 6009 MiB
Device Sys Mem     : 0 MiB
Share Sys Mem      : 8057 MiB
Feature Level      : 0x0000B100
Capture size       : 2560x1440
Offset             : 0x0
Virtual Desktop    : 2560x1440
[2024:06:03:22:13:22]: Info: Active GPU has HAGS disabled
[2024:06:03:22:13:22]: Info: Using realtime GPU priority
[2024:06:03:22:13:22]: Error: Failed to sync desktop to thread [0x000000AA]
[2024:06:03:22:13:22]: Info: Desktop resolution [2560x1440]
[2024:06:03:22:13:22]: Info: Desktop format [DXGI_FORMAT_B8G8R8A8_UNORM]
[2024:06:03:22:13:22]: Info: Display refresh rate [164.998Hz]
[2024:06:03:22:13:22]: Info: Requested frame rate [60fps]
[2024:06:03:22:13:22]: Info:
Colorspace         : DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
Bits Per Color     : 8
Red Primary        : [0.6875,0.308594]
Green Primary      : [0.265625,0.665039]
Blue Primary       : [0.148438,0.046875]
White Point        : [0.313477,0.329102]
Min Luminance      : 0.0004 nits
Max Luminance      : 301.849 nits
Max Full Luminance : 243.056 nits
[2024:06:03:22:13:22]: Info: SDR color coding [Rec. 709]
[2024:06:03:22:13:22]: Info: Color depth: 10-bit
[2024:06:03:22:13:22]: Info: Color range: [JPEG]
[2024:06:03:22:13:22]: Info: NvEnc: created encoder P1 10-bit two-pass rfi
[2024:06:03:22:13:22]: Info:
[2024:06:03:22:13:22]: Info: // Ignore any errors mentioned above, they are not relevant. //
[2024:06:03:22:13:22]: Info:
[2024:06:03:22:13:22]: Info: Found H.264 encoder: h264_nvenc [nvenc]
[2024:06:03:22:13:22]: Info: Found HEVC encoder: hevc_nvenc [nvenc]
[2024:06:03:22:13:22]: Info: Configuration UI available at [https://localhost:47990]
[2024:06:03:22:13:23]: Info: Registered Sunshine mDNS service
[2024:06:03:22:14:31]: Info: Web UI: [127.0.0.1] -- not authorized
[2024:06:03:22:14:32]: Info: Web UI: [127.0.0.1] -- not authorized
[2024:06:03:22:14:34]: Info: Web UI: [127.0.0.1] -- not authorized

[Kane-Kuroneko]

I suppose it is caused by the fact that Sunshine was running on your built-in screen. Your laptop can’t use Nvidia GPU encoding directly. You should try to connect a monitor through your laptop’s graphic port, like HDMI or DP. That may let your GPU connect to the monitor directly, as it won’t pass through the core graphic card. Once you see this wiring diagram, you’ve succeeded.