4 ms·

Have you tried talking to Siri? Compare that to ChatGPT and you'll see that it's much better. The predictive nature of LLMs are perfect for voice assistant use

Have you tried talking to Siri? Compare that to ChatGPT and you'll see that it's much better. The predictive nature of LLMs are perfect for voice assistant use cases, which when connected to "plugins" means we'll all have our own personal assistants. That's worth something.

input_sh 3y ago
Why would they want to run LLM queries every time someone asks Siri for the normal shit people ask their voice assistants: weather, timers, controlling music; on a scale of every iPhone user out there. It'd just be waisting compute money with no obvious way of recouping the cost. Doubt many people would be interested in paying for Siri.
- wes-k 3y ago
  They already run compute for siri for voice to text. So they could in theory still provide an LLM backed siri service for free for their customers/users.
moooo99 3y ago
> The predictive nature of LLMs are perfect for voice assistant use cases But people in general don't seem to be interested in voice assistants in general. They were a huge hype when you basically had to manually uncheck boxes to not accidentially order an Amazon Echo, etc, but as quick as the hype was there it was gone. To my knowledge Amazon has yet to make any kind of substantial revenue with Alexa stuff. With LLMs I would expect this to be even more of an issue given how costly the inferencing alone is when we're talking about an LLM. And yes, the utility will likely increase substantially with the adoption of LLMs as opposed to previous language processing techniques, but I don't think this will outweigh the disinterest in the overall technology.
- MyFirstSass 3y ago
  People aren't that interested in voice assistants atm, though i know plenty people who look up stuff, start music etc with it. When voice synthesis, long context etc. i'm pretty sure a lot of people would love to have a private "Her" like friend/assistant that could both be therapy, a PA and a friend, and i don't think we're that far from that. Dystopian and lonely as it is.
- jordanpg 3y ago
  I'm not interested in voice assistants because they suck at the moment. When they achieve something like 99.9999% accuracy and near-undetectable latency, I will become much more interested in them. As it stands now, if I have to repeat something -- ever -- I'd rather just type it.

input_sh 3y ago

Why would they want to run LLM queries every time someone asks Siri for the normal shit people ask their voice assistants: weather, timers, controlling music; on a scale of every iPhone user out there. It'd just be waisting compute money with no obvious way of recouping the cost. Doubt many people would be interested in paying for Siri.

wes-k 3y ago
They already run compute for siri for voice to text. So they could in theory still provide an LLM backed siri service for free for their customers/users.

moooo99 3y ago

> The predictive nature of LLMs are perfect for voice assistant use cases But people in general don't seem to be interested in voice assistants in general. They were a huge hype when you basically had to manually uncheck boxes to not accidentially order an Amazon Echo, etc, but as quick as the hype was there it was gone. To my knowledge Amazon has yet to make any kind of substantial revenue with Alexa stuff. With LLMs I would expect this to be even more of an issue given how costly the inferencing alone is when we're talking about an LLM. And yes, the utility will likely increase substantially with the adoption of LLMs as opposed to previous language processing techniques, but I don't think this will outweigh the disinterest in the overall technology.

MyFirstSass 3y ago
People aren't that interested in voice assistants atm, though i know plenty people who look up stuff, start music etc with it. When voice synthesis, long context etc. i'm pretty sure a lot of people would love to have a private "Her" like friend/assistant that could both be therapy, a PA and a friend, and i don't think we're that far from that. Dystopian and lonely as it is.
jordanpg 3y ago
I'm not interested in voice assistants because they suck at the moment. When they achieve something like 99.9999% accuracy and near-undetectable latency, I will become much more interested in them. As it stands now, if I have to repeat something -- ever -- I'd rather just type it.