3 ms·

My biggest disappointment was that Apple said nothing about leveraging GPT-4 to improve voice recognition in iMessage. Voice recognition of ChatGPT is incredibl

My biggest disappointment was that Apple said nothing about leveraging GPT-4 to improve voice recognition in iMessage. Voice recognition of ChatGPT is incredibly accurate when compared to iOS. ChatGPT almost never gets anything wrong, while iMessage/iOS voice recognition is extremely frustrating. So much so that I sometimes dictate to ChatGPT then cut & paste into iMessage.

noahtallen 2y ago
They did talk about Siri being better at voice recognition using Apple's own on-device models, so I imagine that will eventually apply more broadly.
- breadwinner 2y ago
  On-device models will not be big enough in the near future. What makes ChatGPT so awesome at recognition is that their model is huge, and so no matter how obscure the topic of the dictation, ChatGPT knows what you're talking about.
  - noahtallen 2y ago
    Apple also talked about their private compute cloud, which allows larger models and workflows to integrate with local AI models. It sounds like they will figure out which features require bigger models and which don't. So I think there is a lot of room for what you're mentioning in the future of this AI platform. Plus, they talk about live phone call transcriptions, voice transcription in notes, the ability to correct words as you speak, contextual conversations in siri, etc. It 100% sounds like better voice recognition is coming
  - extr 2y ago
    Pretty sure transcription is done locally on Pixel phones and it's pretty good. Not as good as ChatGPT, but most of the way there. If current iOS is like a 50, Pixel is like a 90 and OpenAI is like 98.
extr 2y ago
You can set up a shortcut that will record you, hit the Whisper API, then copy to your clipboard. It's not as smooth as native transcription or the SOTA on Google phones but it's pretty good.

3 ms·

My biggest disappointment was that Apple said nothing about leveraging GPT-4 to improve voice recognition in iMessage. Voice recognition of ChatGPT is incredibl

by breadwinner 2y ago

noahtallen 2y ago
They did talk about Siri being better at voice recognition using Apple's own on-device models, so I imagine that will eventually apply more broadly.
- breadwinner 2y ago
  On-device models will not be big enough in the near future. What makes ChatGPT so awesome at recognition is that their model is huge, and so no matter how obscure the topic of the dictation, ChatGPT knows what you're talking about.
  - noahtallen 2y ago
    Apple also talked about their private compute cloud, which allows larger models and workflows to integrate with local AI models. It sounds like they will figure out which features require bigger models and which don't. So I think there is a lot of room for what you're mentioning in the future of this AI platform. Plus, they talk about live phone call transcriptions, voice transcription in notes, the ability to correct words as you speak, contextual conversations in siri, etc. It 100% sounds like better voice recognition is coming
  - extr 2y ago
    Pretty sure transcription is done locally on Pixel phones and it's pretty good. Not as good as ChatGPT, but most of the way there. If current iOS is like a 50, Pixel is like a 90 and OpenAI is like 98.
extr 2y ago
You can set up a shortcut that will record you, hit the Whisper API, then copy to your clipboard. It's not as smooth as native transcription or the SOTA on Google phones but it's pretty good.