4 ms·

Last year we added CLIP-based image search to https://immich.app/ https://immich.app/ and even though I have a pretty good understanding of how it works, it sti

by bo0tzz 3y ago

Last year we added CLIP-based image search to https://immich.app/ https://immich.app/ and even though I have a pretty good understanding of how it works, it still blows my mind damn near every day. It's the closest thing to magic I've ever seen.

apricot13 3y ago
Just needs OCR for the perfect meme searching solution!
- bo0tzz 3y ago
  OCR will be there at some point, but it already does a surprisingly good job without!
  - itake 3y ago
    I'd also consider adding searching via QR codes. you could search by the content in the QR code (like the url) or if its a URL, search the content on the page of the QR code.
    - Eisenstein 3y ago
      Why? I can't think of a use for this.
      - itake 3y ago
        people that have a lot of photos with QR codes would want it :). You could search your images for qr codes that go to linkedin, ig, or fb pages. or find the qr code wifi passwords. if you just have a screenshot of a QR code (like you zoomed in and screenshot the ticket's QR code, no other text), then finding the qr code by the event name could be useful. Thailand requires qr codes that linked to the nutritional information registered online. this could be useful to help you search products that just show the back of the label and not the front of the product.
dsvf 3y ago
Happy immich user here! I once took a cute photo of our baby chewing on a whisk, and actually finding the correct photo in an unsorted, untagged huge pile of photos by simply searching for "whisk" was a mindblow experience! It is an amazingly powerful tool!
- pwillia7 3y ago
  How does it compare to Google Photo search? I search things like 'whisk' with success regularly... though to be fair not as random as whisk, but things like "steering wheel"
fxtentacle 3y ago
Wow I have been looking for something like that for a long time. Thanks for telling me about immich :)
wruza 3y ago
The “Demo portal” link breaks back button, btw.
atif089 3y ago
Thanks for sharing about immich. I have a task that has been on my to-do list for several years now. Amongst all the WhatsApp media on my phone I would like to get a list of all the videos and photos with my family in it and then delete the rest. Is something like this possible with immich?
- atif089 2y ago
  For anyone in the same boat as my self, I later found out that this is actually very easy to achieve (thanks to ChatGPT). Theoretically, this is how it is done 1. Encode faces, there is a library called face_recognition, that can grab faces from pictures and encode them 2. Group the faces data using `pairwise_distances(encodings, metric='euclidean')`, you only need sklearn library for this

by bo0tzz 3y ago

apricot13 3y ago

Just needs OCR for the perfect meme searching solution!

bo0tzz 3y ago
OCR will be there at some point, but it already does a surprisingly good job without!
- itake 3y ago
  I'd also consider adding searching via QR codes. you could search by the content in the QR code (like the url) or if its a URL, search the content on the page of the QR code.
  - Eisenstein 3y ago
    Why? I can't think of a use for this.
    - itake 3y ago
      people that have a lot of photos with QR codes would want it :). You could search your images for qr codes that go to linkedin, ig, or fb pages. or find the qr code wifi passwords. if you just have a screenshot of a QR code (like you zoomed in and screenshot the ticket's QR code, no other text), then finding the qr code by the event name could be useful. Thailand requires qr codes that linked to the nutritional information registered online. this could be useful to help you search products that just show the back of the label and not the front of the product.

dsvf 3y ago

Happy immich user here! I once took a cute photo of our baby chewing on a whisk, and actually finding the correct photo in an unsorted, untagged huge pile of photos by simply searching for "whisk" was a mindblow experience! It is an amazingly powerful tool!

pwillia7 3y ago
How does it compare to Google Photo search? I search things like 'whisk' with success regularly... though to be fair not as random as whisk, but things like "steering wheel"

fxtentacle 3y ago

Wow I have been looking for something like that for a long time. Thanks for telling me about immich :)

wruza 3y ago

The “Demo portal” link breaks back button, btw.

atif089 3y ago

Thanks for sharing about immich. I have a task that has been on my to-do list for several years now. Amongst all the WhatsApp media on my phone I would like to get a list of all the videos and photos with my family in it and then delete the rest. Is something like this possible with immich?

atif089 2y ago
For anyone in the same boat as my self, I later found out that this is actually very easy to achieve (thanks to ChatGPT). Theoretically, this is how it is done 1. Encode faces, there is a library called face_recognition, that can grab faces from pictures and encode them 2. Group the faces data using `pairwise_distances(encodings, metric='euclidean')`, you only need sklearn library for this