4 ms·
It’s gotta be just barely holding on in some legacy environment right now. I’m surprised they don’t just start over using new tech. Maybe that’s the end goal
by binarymax 2y ago
It’s gotta be just barely holding on in some legacy environment right now. I’m surprised they don’t just start over using new tech. Maybe that’s the end goal with on-device inference to sunset cloud Siri.
- grahamj 2y agoI think it’s at least partly cost reduction. Push everything to the phone so people have to pay more for phones and they pay less for infra. Win-win. Otherwise why don’t they let older devices use their server-side private LLM setup?
- Benjaminsen 2y agoOpenAI whisper runs on iOS native on device, can't be just costs. https://github.com/openai/whisper/discussions/407 https://github.com/openai/whisper/discussions/407