2 ms·
Google's own Gemma models are runnable locally on a Pixel 9 Max so some lev of AI is replicatable client side. As far as Gmail running locally, it wouldn't be i
by fragmede 1y ago
Google's own Gemma models are runnable locally on a Pixel 9 Max so some lev of AI is replicatable client side. As far as Gmail running locally, it wouldn't be impossible for Gmail to be locally hosted and hit a local cache which syncs with a server only periodically over IMAP/JMAP/whatever if Google actually wanted to do it.
- eru 1y agoYes, but seems like a lot of hassle for not much gain (for Google).
- fragmede 1y agoThe gain, as far as local AI goes for Google, is that, at Google scale, the CPU/GPU time to run even a small model like Gemma will add up across Gmail's millions of users. If clients have the hardware for it (which Pixel 9's have) it means Gmail's servers aren't burning CPU/GPU time on it. As far as how Gmail's existing offline mode works, I don't know.
- eru 1y agoTo make the discussion easier, we can look at the state of GMail before widespread AI was a thing. (I have to use some weaselwording here, because GMail had decent spam detection since basically forever, and whether you call that AI or not depends on where we have shifted the goalposts at the moment.)
- fragmede 1y agoHeh that brings to mind that old chestnut, something like "We call it AI until it works, then we call it machine learning." Google's running the servers tho, so the assumption is the servers would be running the spam filter against it before the user. In my mind, anyway. So it's fair to point out that Google also has the compute resources to not have to care. To the hypothetical though, could Google make Gmail a local-first? I say yes. Will they? I doubt it.