4 ms·
GPT4o access is a handy feature, but, what I was hoping to hear about is an improvement in Siri's language "understanding." In today's WWDC presentation, there
by getpost 2y ago
GPT4o access is a handy feature, but, what I was hoping to hear about is an improvement in Siri's language "understanding."
In today's WWDC presentation, there were a few small examples of Siri improvements, such as an ability to maintain context, e.g., 'Add her flight arrival time to my calendar,' wherein Siri knows who "her" refers to.
In my day-to-day experience with Siri, it's clear Siri doesn't have the kind of ability to understand language that LLMs provide. It still feels like clever son-of-Eliza hacks with stock phrases. If your utterance doesn't match with a pre-programmed stock phrase, it doesn't work. The other day I said something like "Play the song you played before the one I asked you to skip," and Siri didn't seem to know what I wanted. OTOH, GPT4o can easily handle statements like that.
Does anyone know to what extent Siri's underlying language models are being upgraded?
- stbenjam 2y ago> In today's WWDC presentation, there were a few small examples of Siri improvements, such as an ability to maintain context, e.g., 'Add her flight arrival time to my calendar,' wherein Siri knows who "her" refers to. Didn't Cortana do this? Pretty underwhelming in 2024.
- asdasdsddd 2y agoSiri just feels like, tokenize input => run classifier over hardcoded actions.
- shepherdjerred 2y agoI don't think these actions are hardcoded with the App Intents framework. Even today you can ask Siri to run arbitrary shortcuts via custom keywords.
- shepherdjerred 2y agoI agree, this is the biggest annoyance with voice assistants today. The good news is that, as you noted, the technology to interpret complex/unclear requests is definitely already here today with ChatGPT. I think that Apple demoed this today where the presenter changed her mind mid-sentence during a weather query. I'm hopeful that means they've added a LLM to interpret the intent of user requests.
- TeMPOraL 2y agoThat's something that I keep wondering about. The existing voice assistants are all garbage across the board. Whatever you say about Siri, Google's assistant is even worse. Meanwhile, for the past couple months, I was able to fire up ChatGPT app and speak to it casually, in noisy environments, and it would both correctly convert my speech to text (with less than 5% errors) and correctly understand what I'm actually saying (even in presence of transcription errors). All it takes to make a qualitatively better voice assistant would be to give GPT-4 a spec of functions representing things it can do on your phone, and integrating that with the OS. So why none of the companies bothered to do it? For that matter, I wonder why OpenAI didn't extend the ChatGPT app in this direction?
- noahtallen 2y agoI thought from the Apple keynote that Siri is getting a big update to be based on Apple Intelligence, not that this context stuff was getting hacked into the existing Siri model. They talked about new voice transcription features, the ability to correct yourself while talking, deep knowledge of your personal context, etc. It sounds like a bigger update, where they’re applying gen AI models more broadly across tons of things (including I things like photo categorization), but I guess we’ll see.
- saagarjha 2y agoIt's worth noting that Apple has been claiming to be able to do this for quite some time. At this point I'm not particularly inclined to believe them.
- aixpert 2y agobeing "English only" also indicates that in order to have GPT level comprehension you need to use the real thing.