4 ms·
This wouldn't align with what Apple is going for though. Their selling point in this category is first and foremost that your data stays private. They're lookin
by Etheryte 2y ago
This wouldn't align with what Apple is going for though. Their selling point in this category is first and foremost that your data stays private. They're looking to do as much as possible on-device, not in the cloud. This rules out models akin to o1 because they're just too large in every respect. I agree that Apple has the chance to do amazing things here, but I think it will take a while until small models are as capable as they need them to be.
- xvector 2y agoThe problem is they compromised on both fronts (privacy, compute) and produced something that is ultimately a useless joke. They could have produced something that was good and required accepting a privacy disclaimer to use. Or they could have waited until they managed to catch up with the rest of the industry wrt good 3B parameter models (the one they're using is incredibly terrible.) Instead we got this half-assed compromise. The execs in charge of Siri are demonstrably terrible at their job and should feel bad. It's incredible they get paid the millions they do while doing such a horrible job.