6 ms·

Was there anything about searching through our own photos using prompts? I thought this could be pretty amazing and still a natural way to find very specific ph

Was there anything about searching through our own photos using prompts? I thought this could be pretty amazing and still a natural way to find very specific photos in one’s own photo gallery.

avereveard 2y ago
Which is in turn just multimodal embedding Besides I could do "named person on a beach in August" and get the correct thing in photos on Android photos, so I don't get it. It's amazing for apple users if they didn't have it before. But from a tech stand point people could have had it for a while.
- azinman2 2y ago
  Photos has had this for a while with structured natural language queries, and this kind of prompt was part of the WWDC video.
- theshrike79 2y ago
  The difference is that Apple has been doing this on-device for maybe 4-5 years already with the Neural Engine. Every iOS version has brought more stuff you can search for. The current addition is "just" about adding a natural language interface on top of data they already have about your photos (on device, not in the cloud). My iPhone 14 can, for example, detect the breed of my dog correctly from the pictures and it can search for a specific pet by name. Again on-device, not by sending my stuff to Google's cloud to be analysed.
  - fauigerzigerk 2y ago
    They have been trying and failing to do a tiny little bit of this. It's so broken and useless that I've been uploading all my iCloud photos to Google as well, for search and sharing.
    - theshrike79 2y ago
      If you like Google using your personal photos for machine learning, that's your option. Now they have your every photo, geotagged and timestamped so they can see where you have been and at what times. Then they of course anonymise that information into an "advertiser id" they tag on to you and a sufficient quantity of other people so they can claim they're not directly targeting anyone. I prefer Apple's privacy focused option myself.
      - fauigerzigerk 2y ago
        >If you like Google using your personal photos for machine learning, that's your option. It's a trade-off between getting the features I need and the price I have to pay. All else being equal I do prefer privacy as well. Unfortunately, all else is not equal. >I prefer Apple's privacy focused option myself. It's only an option if it works.
mazzystar 2y ago
Run OpenAI's CLIP model on iOS to search photos. https://github.com/mazzzystar/Queryable https://github.com/mazzzystar/Queryable
- gigglesupstairs 2y ago
  Yes, exactly this. I have had this for a while and works wonderfully well in most cases but it’s wonky and not seamless. I wanted a more integrated approach with Photos app which only Apple can bring to the table.

Was there anything about searching through our own photos using prompts? I thought this could be pretty amazing and still a natural way to find very specific photos in one’s own photo gallery.

avereveard 2y ago

Which is in turn just multimodal embedding Besides I could do "named person on a beach in August" and get the correct thing in photos on Android photos, so I don't get it. It's amazing for apple users if they didn't have it before. But from a tech stand point people could have had it for a while.

azinman2 2y ago
Photos has had this for a while with structured natural language queries, and this kind of prompt was part of the WWDC video.
theshrike79 2y ago
The difference is that Apple has been doing this on-device for maybe 4-5 years already with the Neural Engine. Every iOS version has brought more stuff you can search for. The current addition is "just" about adding a natural language interface on top of data they already have about your photos (on device, not in the cloud). My iPhone 14 can, for example, detect the breed of my dog correctly from the pictures and it can search for a specific pet by name. Again on-device, not by sending my stuff to Google's cloud to be analysed.
- fauigerzigerk 2y ago
  They have been trying and failing to do a tiny little bit of this. It's so broken and useless that I've been uploading all my iCloud photos to Google as well, for search and sharing.
  - theshrike79 2y ago
    If you like Google using your personal photos for machine learning, that's your option. Now they have your every photo, geotagged and timestamped so they can see where you have been and at what times. Then they of course anonymise that information into an "advertiser id" they tag on to you and a sufficient quantity of other people so they can claim they're not directly targeting anyone. I prefer Apple's privacy focused option myself.
    - fauigerzigerk 2y ago
      >If you like Google using your personal photos for machine learning, that's your option. It's a trade-off between getting the features I need and the price I have to pay. All else being equal I do prefer privacy as well. Unfortunately, all else is not equal. >I prefer Apple's privacy focused option myself. It's only an option if it works.

mazzystar 2y ago

Run OpenAI's CLIP model on iOS to search photos. https://github.com/mazzzystar/Queryable https://github.com/mazzzystar/Queryable

gigglesupstairs 2y ago
Yes, exactly this. I have had this for a while and works wonderfully well in most cases but it’s wonky and not seamless. I wanted a more integrated approach with Photos app which only Apple can bring to the table.