4 ms·

It's pretty stunning that no one has hooked their voice assistant up to an LLM yet. Alexa, Siri, Google, etc. are all trash that could easily be improved 1000x

It's pretty stunning that no one has hooked their voice assistant up to an LLM yet. Alexa, Siri, Google, etc. are all trash that could easily be improved 1000x by leveraging existing LLM technologies.

charcircuit 3y ago
Meta's 2nd version of their smart glasses replaced the traditional voice assistant of the first one with a LLM based one.
Jensson 3y ago
Google apparently already started, it was linked in the article: https://www.businessinsider.com/google-assistant-with-bard-new-app-chatbot-ai-voice-text-2023-10?r=US&IR=T https://www.businessinsider.com/google-assistant-with-bard-n...
- brabel 3y ago
  That will be great, everyone expects much more from "AI" (and at least I consider voice assistants to be an early AI prototype) and it would be great to have voice assistants understand what we ask better (like ChatGPT would, and perhaps Bard).
yieldcrv 3y ago
you don’t like getting the weather and unsolicited google results?
selcuka 3y ago
I believe it's because it's at least a magnitude more expensive to run an LLM instead of a basic voice assistant ML model. Especially when considering anyone who has purchased a Google Nest Mini can use it, for free, forever.
- yesimahuman 3y ago
  And when you consider these voice assistants already feel at risk for further investment due to subpar results, it makes sense. Bit of a catch-22 though as many of us have given up on expecting much out of our existing ones
- AdrenalinMd 3y ago
  But a lot of the question /responses could be trivial cached. No need to run expensive LLM every time for the same basic "how are you today?" prompts, it only has to be cached once.
  - poisonborz 3y ago
    Caching static requests alone is hard enough. With all the ways you can ask this question, welcome to the most complicated caching backend ever. Caching exact matches would also not help much because of this.
  - dartos 3y ago
    Then you’re kind of defeating the purpose of an llm. Fixed responses for common queries is what we have now. Not to mention that LLMs tend to be very wordy right now. I’d hate to way 20 seconds to hear my phone say “As a voice assistant I’m not aware of the exact menu of the Thai restaurant on 2nd, but I have opened a google search for it and found the following results. …”
    - tpmx 3y ago
      "You are a Siri-style voice assistant. Be succinct and terse, but polite and helpful." seems to work okay with ChatGPT.
      - dartos 3y ago
        It’s been a mixed bag for me. Sometimes the responses are still wordy, especially when you hit one of the “As an AI…” gates
- erhaetherth 3y ago
  run "set timer" and "what's the weather" and "turn on the lights" through some regexes as a first pass and save the LLM for the complicated stuff. actually, with some caching they can probably cut costs pretty heavily there too.
  - janalsncm 3y ago
    I’m guessing they are already doing this. Adding an LLM is asking to add a very expensive thing to the long tail of queries which likely cannot be cached.
- lesuorac 3y ago
  > Google Nest Mini can use it, for free, forever Is that a contractual obligation? otherwise what stops the Mini from going the way of a Jamboard?
syspec 3y ago
You can do this on your iPhone for sure via a Shortcut. https://www.zdnet.com/google-amp/article/how-to-use-chatgpt-as-a-siri-shortcut-on-your-iphone-or-ipad/ https://www.zdnet.com/google-amp/article/how-to-use-chatgpt-...
__derek__ 3y ago
Alexa Let's Chat was announced last month, but not yet launched.[1] [1]: https://www.amazon.com/b?node=118801773011 https://www.amazon.com/b?node=118801773011
deleted 3y ago
[deleted]
maldev 3y ago
Unironically Mercedes has made their voice assistants in the car leverage ChatGpt. Something is really wrong when a car company is beating tech companies to the punch with tech innovation.
hulitu 3y ago
As a computer, i find your trust in technology amusing. /s

charcircuit 3y ago

Meta's 2nd version of their smart glasses replaced the traditional voice assistant of the first one with a LLM based one.

Jensson 3y ago

Google apparently already started, it was linked in the article: https://www.businessinsider.com/google-assistant-with-bard-new-app-chatbot-ai-voice-text-2023-10?r=US&IR=T https://www.businessinsider.com/google-assistant-with-bard-n...

brabel 3y ago
That will be great, everyone expects much more from "AI" (and at least I consider voice assistants to be an early AI prototype) and it would be great to have voice assistants understand what we ask better (like ChatGPT would, and perhaps Bard).

yieldcrv 3y ago

you don’t like getting the weather and unsolicited google results?

selcuka 3y ago

I believe it's because it's at least a magnitude more expensive to run an LLM instead of a basic voice assistant ML model. Especially when considering anyone who has purchased a Google Nest Mini can use it, for free, forever.

yesimahuman 3y ago
And when you consider these voice assistants already feel at risk for further investment due to subpar results, it makes sense. Bit of a catch-22 though as many of us have given up on expecting much out of our existing ones
AdrenalinMd 3y ago
But a lot of the question /responses could be trivial cached. No need to run expensive LLM every time for the same basic "how are you today?" prompts, it only has to be cached once.
- poisonborz 3y ago
  Caching static requests alone is hard enough. With all the ways you can ask this question, welcome to the most complicated caching backend ever. Caching exact matches would also not help much because of this.
- dartos 3y ago
  Then you’re kind of defeating the purpose of an llm. Fixed responses for common queries is what we have now. Not to mention that LLMs tend to be very wordy right now. I’d hate to way 20 seconds to hear my phone say “As a voice assistant I’m not aware of the exact menu of the Thai restaurant on 2nd, but I have opened a google search for it and found the following results. …”
  - tpmx 3y ago
    "You are a Siri-style voice assistant. Be succinct and terse, but polite and helpful." seems to work okay with ChatGPT.
    - dartos 3y ago
      It’s been a mixed bag for me. Sometimes the responses are still wordy, especially when you hit one of the “As an AI…” gates
erhaetherth 3y ago
run "set timer" and "what's the weather" and "turn on the lights" through some regexes as a first pass and save the LLM for the complicated stuff. actually, with some caching they can probably cut costs pretty heavily there too.
- janalsncm 3y ago
  I’m guessing they are already doing this. Adding an LLM is asking to add a very expensive thing to the long tail of queries which likely cannot be cached.
lesuorac 3y ago
> Google Nest Mini can use it, for free, forever Is that a contractual obligation? otherwise what stops the Mini from going the way of a Jamboard?

syspec 3y ago

You can do this on your iPhone for sure via a Shortcut. https://www.zdnet.com/google-amp/article/how-to-use-chatgpt-as-a-siri-shortcut-on-your-iphone-or-ipad/ https://www.zdnet.com/google-amp/article/how-to-use-chatgpt-...

__derek__ 3y ago

Alexa Let's Chat was announced last month, but not yet launched.[1] [1]: https://www.amazon.com/b?node=118801773011 https://www.amazon.com/b?node=118801773011

deleted 3y ago

[deleted]

maldev 3y ago

Unironically Mercedes has made their voice assistants in the car leverage ChatGpt. Something is really wrong when a car company is beating tech companies to the punch with tech innovation.

hulitu 3y ago

As a computer, i find your trust in technology amusing. /s