-
-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
image database are not updated / not all images from external source imported #14575
Comments
Can you try to post a log file? |
if i try to generate new thumbnails, then i get the following error. `[Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
[Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Object: { "id": "9b1f29e1-417a-4dd8-8767-0683b7791ad4" } [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:535: Incomplete scan detected. VipsJpeg: ./lib/jpegli/decode_marker.cc:60: Duplicate SOF marker. [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:535: Incomplete scan detected. VipsJpeg: ./lib/jpegli/decode_marker.cc:60: Duplicate SOF marker.
[Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Object: { "id": "6ea71293-a99a-4f1a-9b02-1210fa1a6a0f" } [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Error: Input file contains unsupported image format
[Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Object: { "id": "f07a57de-f727-4beb-9f38-58ddddf2d25f" } [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Error: Input file contains unsupported image format
[Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Object: { "id": "8093928f-71f9-45b3-a600-2e56b48e7251" } [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: ffprobe exited with code 1 ffprobe version 7.0.2-Jellyfin Copyright (c) 2007-2024 the FFmpeg developers built with gcc 12 (Debian 12.2.0-14) configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto=auto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-opencl --enable-libdrm --enable-libxml2 --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libharfbuzz --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libsvtav1 --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc libavutil 59. 8.100 / 59. 8.100 libavcodec 61. 3.100 / 61. 3.100 libavformat 61. 1.100 / 61. 1.100 libavdevice 61. 1.100 / 61. 1.100 libavfilter 10. 1.100 / 10. 1.100 libswscale 8. 1.100 / 8. 1.100 libswresample 5. 1.100 / 5. 1.100 libpostproc 58. 1.100 / 58. 1.100 [mov,mp4,m4a,3gp,3g2,mj2 @ 0x342aa060180] Format mov,mp4,m4a,3gp,3g2,mj2 detected only with low score of 1, misdetection possible! [mov,mp4,m4a,3gp,3g2,mj2 @ 0x342aa060180] moov atom not found /media/webs/TB4/video/Daten/Alex/HandyBackup/SDCard/Camera/VID_20230714_143414.mp4: Invalid data found when processing input [Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Error: ffprobe exited with code 1 ffprobe version 7.0.2-Jellyfin Copyright (c) 2007-2024 the FFmpeg developers built with gcc 12 (Debian 12.2.0-14) configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto=auto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-opencl --enable-libdrm --enable-libxml2 --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libharfbuzz --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libsvtav1 --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc libavutil 59. 8.100 / 59. 8.100 libavcodec 61. 3.100 / 61. 3.100 libavformat 61. 1.100 / 61. 1.100 libavdevice 61. 1.100 / 61. 1.100 libavfilter 10. 1.100 / 10. 1.100 libswscale 8. 1.100 / 8. 1.100 libswresample 5. 1.100 / 5. 1.100 libpostproc 58. 1.100 / 58. 1.100 [mov,mp4,m4a,3gp,3g2,mj2 @ 0x342aa060180] Format mov,mp4,m4a,3gp,3g2,mj2 detected only with low score of 1, misdetection possible! [mov,mp4,m4a,3gp,3g2,mj2 @ 0x342aa060180] moov atom not found /media/webs/TB4/video/Daten/Alex/HandyBackup/SDCard/Camera/VID_20230714_143414.mp4: Invalid data found when processing input
[Nest] 7 - 12/08/2024, 11:48:01 PM ERROR [Microservices:JobService] Object: { "id": "67a6190f-312d-4a91-9a56-f0c933ea72f2" } [Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block [Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
[Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Object: { "id": "9884d10c-14f4-4ec7-9afe-44d3bbc743bd" } [Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block [Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
[Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Object: { "id": "6c3e9ba3-1345-4880-9ebe-a96adcbfdd6d" } [Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block [Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
[Nest] 7 - 12/08/2024, 11:48:02 PM ERROR [Microservices:JobService] Object: { "id": "42c0836f-0b6f-4f4b-9083-5e98f1fc332b" } [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Error: Input file contains unsupported image format
[Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Object: { "id": "154c0053-89bf-4d29-b12d-c5e0f89acdab" } [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: No video streams found for asset 5743b125-350e-4e9a-8aa2-8a98ceb409df [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Error: No video streams found for asset 5743b125-350e-4e9a-8aa2-8a98ceb409df
[Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Object: { "id": "5743b125-350e-4e9a-8aa2-8a98ceb409df" } [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Error: Input file contains unsupported image format
[Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Object: { "id": "3bd0696d-dc3c-4ec0-a9c7-a329d0a24478" } [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format [Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Error: Input file contains unsupported image format
[Nest] 7 - 12/08/2024, 11:48:03 PM ERROR [Microservices:JobService] Object: { "id": "7f8c6c36-1fec-4167-adcf-da1274d4bc85" }
|
If i update the library, i just get the log: `[Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'thumbnailGeneration' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'metadataExtraction' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'videoConversion' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'faceDetection' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'facialRecognition' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'smartSearch' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'duplicateDetection' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'backgroundTask' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'storageTemplateMigration' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'migration' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'search' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'sidecar' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'library' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'notifications' [Nest] 17 - 12/08/2024, 11:53:18 PM WARN [Api:JobRepository~xpt9kbgt] Unable to set queue concurrency, worker not found: 'backupDatabase'` |
The bug
finally, some thousands photos are not imported in the thumbnail database, because of the import stops always on the corrupted files, which are already deleted
The OS that Immich Server is running on
Linux Mint 21.3
Version of Immich Server
v1.122.1
Version of Immich Mobile App
Platform with the issue
Your docker-compose.yml content
Your .env content
Reproduction steps
..
Relevant log output
No response
Additional information
No response
The text was updated successfully, but these errors were encountered: