3 ms·
I am sure Apple leadership agrees with your overall idea of on-device, but don’t see how this could compete with big GPUs in a data center for “actually doing a
by xp84 3y ago
I am sure Apple leadership agrees with your overall idea of on-device, but don’t see how this could compete with big GPUs in a data center for “actually doing a good job.” Apple is a distant last place in everything to do with AI today, so I’m skeptical that they can suddenly make an impact with both hands tied around their back (in other words 1/100th the TDP, one iPhone chip on battery vs farms of GPUs).
I’d honestly more appreciate the ability to choose “best quality with theoretical decrease in ‘privacy’” over “best that you can do without hurting the tiny iPhone battery but perfect privacy.” I’d always pick the first one if given the choice.
- gnicholas 3y agoI think the way they could compete is by having on-device handle a limit universe of queries, and then use some souped-up Siri for the rest. Currently iPhones can do some Siri commands even when offline, for example.
- TaylorAlexander 3y agoHell even the most recent Apple Watch does some Siri commands, including voice to text, on device. Apple is certainly pushing low power on device processing with their own custom chips (S9 on the watch I believe).
- gnicholas 3y agoYep, I could totally see them enabling this only on Pro-level iPhones, for example. This would presumably be because Pro devices could have different chips that are designed to handle these specific tasks, as well as having larger batteries. I expect there will be a lot of iPhone upgrades this fall, as buyers will finally see a difference between their 1-3 year old device and a new iPhone.
- TaylorAlexander 3y agoIndeed, this is what the rumor mill is suggesting: https://www.macrumors.com/2024/02/14/iphone-16-upgraded-neural-engine-rumor/ https://www.macrumors.com/2024/02/14/iphone-16-upgraded-neur...