[Feature] Given a photo, find similar photos

[simone-viozzi]

The feature

I propose a feature that uses the existing clip embeddings to query similar photos.

proposed user interface

From an image, add an option under the 3 dot menu'

We can reuse the same interface as a text query

implementation

It should be possible to use the embeddings of an image, to query the clip embeddings of all the other images.
Same that happen with a text query, but using the ones from one image.

Platform

• Server
• Web
• Mobile

[nodis]

This feature is very important and worth looking forward to

[akropp]

Would definitely be useful!

[cunicode]

reference: Librephots has this as a default on the info-panel for each photo
https://github.com/search?q=repo%3ALibrePhotos%2Flibrephotos%20similar&type=code

[yznts]

Feature would be really useful for cleaning up library from lots of similar photos (f.e multiple shots from the same angle)

[ThreeAurora]

This feature is very important.

Right now it is not possible to find similar images or to locate the position of the searched image in the album.

This seems to make the search results "very independent and difficult to manipulate".

[axgdcode]

The feature will be extremely interesting for creating albums and would also provide an advantage over Google Photos

[ThreeAurora]

Yes, but it's been a year and there has been no reply

[klejejs]

There is a similar photo detection feature in works, in fact some its code has already been merged, so I think we can expect something in upcoming releases.

[NicholasFlamy]

#8228 is the backend.

[quinnaissance]

#8228 is the backend.

So as far as I understand it, the only/main backend difference here to finding duplicates would be adjusting the threshold?

[aviv926]

With the new feature that finds duplicates could this be easy to implement? It will be interesting to know what the team thinks about it. Can you put it on Discord?

[bo0tzz]

@mertalev was already playing with it iirc

[aviv926]

@mertalev was already playing with it iirc

Nicee we will wait for the magician 🪄😁

[mertalev]

Nope, I didn't work on this. I think @NicholasFlamy was interested in this feature and was waiting for duplicate detection to be added.

[NicholasFlamy]

@johnjamespj wanted to work on this and I agreed to help but I don't think either of us have done anything yet (I know I haven't).

[SelfSufficient08]

This would be a great feature to add. I often search for a photo, find it and then want to find photos similiar or even find photos from that same day or timeframe.

[Broyojo]

It would also be very important to make a "find similar faces" functionality that measures similarity between provided image of a face or image with a face in it and find other images with similar faces in them.

[NicholasFlamy]

That already exists, you can tap the detected person in the photo and it will show all the photos with that face.

[Broyojo]

Yes, however this requires the face to be in an existing photo in the database and needs to be a valid face (exists across several photos, etc.). I want to be able to give immich and image of a face and it can find me images with the most similar faces

[jerji]

At this point I have almost 100k originals and this feature would be awesome for finding sets and duplicates more specifically.

[Gloryandel]

This is amazing for viewing and exploring similar photos.

[MariasStory]

Should be really easy to implement using searchRepository.searchSmart:

immich/server/src/services/search.service.ts

Line 95 in dd9feee

const { hasNextPage, items } = await this.searchRepository.searchSmart(

Basically, knowing the embedding of the image search similar in pgvector database.
I don't understand why it is not implemented.

[mertalev]

The way I imagine this feature is that you can scroll down from the image and have it show related content (similar photos, albums this photo is in, etc.). I'm not much of a frontend dev, though, and the focus of the dev team is elsewhere. PRs are welcome if anyone wants to take a stab at it.