4 ms·
I think it’s at least partly cost reduction. Push everything to the phone so people have to pay more for phones and they pay less for infra. Win-win. Otherwise
by grahamj 2y ago
I think it’s at least partly cost reduction. Push everything to the phone so people have to pay more for phones and they pay less for infra. Win-win.
Otherwise why don’t they let older devices use their server-side private LLM setup?
- Benjaminsen 2y agoOpenAI whisper runs on iOS native on device, can't be just costs. https://github.com/openai/whisper/discussions/407 https://github.com/openai/whisper/discussions/407