3 ms·

> If it's E2E encrypted, I don't think it'd be able to identify that during transit, so it had to have been locally done. Yes. Image description has been done

> If it's E2E encrypted, I don't think it'd be able to identify that during transit, so it had to have been locally done. Yes. Image description has been done on-device for quite a while now, and it is great. You can look for pictures using a description, and you can look for any text in any picture as well. It works very, very well.

ryanwaggoner 3y ago
Yeah, but I agree with the parent; I think something has changed recently with Siri. The other day I asked it some questions as a joke that I knew would just say "here's what I found on the web", but it answered them. It made me wonder what they're changing under the hood.
sn0wf1re 3y ago
Yeah, apparently well enough to run a web service off of iPhone image recognition! https://findthatmeme.com/blog/2023/01/08/image-stacks-and-iphone-racks-building-an-internet-scale-meme-search-engine-Qzrz7V6T.html https://findthatmeme.com/blog/2023/01/08/image-stacks-and-ip...
- kergonath 3y ago
  That is seriously impressive!
nerdbert 3y ago
> It works very, very well. I had always assumed that search box in Photos.app would be useless, but once in desperation I typed something in and it found exactly what I was looking for (a photo of one of my kids' passports I knew I'd taken but could not for the life of me remember where). Now I use it more and more, it makes my tens of thousands of photos dramatically more useful to me. That time we at at the restaurant with the big shrimp platter? The airbnb we stayed at where I took a picture of the cool coffee table? All right there.
- pertymcpert 3y ago
  Maybe it’s not especially amazing in 2023 but I totally agree. Finding random documents you snapped a photo of because you’re looking for some text that happened to appear on the edge of the page in a tiny font, it’s really useful. L I’ve used the feature to find my cars VIN, passport numbers, random places etc.
brokenmachine 3y ago
My Samsung also does that, though I wouldn't say it works very well.
MonaroVXR 3y ago
Same for Samsung devices with the official Samsung photo app

ryanwaggoner 3y ago

Yeah, but I agree with the parent; I think something has changed recently with Siri. The other day I asked it some questions as a joke that I knew would just say "here's what I found on the web", but it answered them. It made me wonder what they're changing under the hood.

sn0wf1re 3y ago

Yeah, apparently well enough to run a web service off of iPhone image recognition! https://findthatmeme.com/blog/2023/01/08/image-stacks-and-iphone-racks-building-an-internet-scale-meme-search-engine-Qzrz7V6T.html https://findthatmeme.com/blog/2023/01/08/image-stacks-and-ip...

kergonath 3y ago
That is seriously impressive!

nerdbert 3y ago

> It works very, very well. I had always assumed that search box in Photos.app would be useless, but once in desperation I typed something in and it found exactly what I was looking for (a photo of one of my kids' passports I knew I'd taken but could not for the life of me remember where). Now I use it more and more, it makes my tens of thousands of photos dramatically more useful to me. That time we at at the restaurant with the big shrimp platter? The airbnb we stayed at where I took a picture of the cool coffee table? All right there.

pertymcpert 3y ago
Maybe it’s not especially amazing in 2023 but I totally agree. Finding random documents you snapped a photo of because you’re looking for some text that happened to appear on the edge of the page in a tiny font, it’s really useful. L I’ve used the feature to find my cars VIN, passport numbers, random places etc.

brokenmachine 3y ago

My Samsung also does that, though I wouldn't say it works very well.

MonaroVXR 3y ago

Same for Samsung devices with the official Samsung photo app