3 ms·

> This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. Yep -

> This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. Yep - it needs to be ready as soon as I'm done talking and I need to be able to interrupt it. If those things can be done then it can also start tentatively talking if I pause and immediately stop if I continue. I don't want to have to think about how to structure the interaction in terms of explicit call/response chain, nor do I want to have to be super careful to always be talking until I've finished my thought to prevent it from doing its thing at the wrong time.

wkat4242 3y ago
The interruption is an important point yeah. It's so annoying when Siri misunderstands again and starts rattling off a whole host of options. And keeps getting stuck in a loop if you don't respond. In fact I'm really surprised these assistants are still as crap as they are. Totally scripted, zero AI. It seems low hanging fruit to implement an LLM but none of the big three have done so. Not even sure about the fringe ones like Cortana and Bixby
- famouswaffles 3y ago
  I mean Microsoft is planning to. Rolling out as soon as tomorrow. https://youtu.be/5rEZGSFgZVY https://youtu.be/5rEZGSFgZVY
  - wkat4242 3y ago
    Windows 11 copilot is not really the same thing though. They don't do something like homepods you can have around your house.
- singularity2001 3y ago
  The CallAnnie demo allows interruption and its such a leap forward compared to Siri
modeless 3y ago
Yeah when I was developing it, it quickly became apparent that I needed to be able to interrupt it. So I implemented that. Pretty easy to implement actually. Much harder would be to have the model interrupt the human. But I think it is actually desirable for natural conversation, so I do think a turn-taking model should be able to signal the LLM to interrupt the human.

wkat4242 3y ago

The interruption is an important point yeah. It's so annoying when Siri misunderstands again and starts rattling off a whole host of options. And keeps getting stuck in a loop if you don't respond. In fact I'm really surprised these assistants are still as crap as they are. Totally scripted, zero AI. It seems low hanging fruit to implement an LLM but none of the big three have done so. Not even sure about the fringe ones like Cortana and Bixby

famouswaffles 3y ago
I mean Microsoft is planning to. Rolling out as soon as tomorrow. https://youtu.be/5rEZGSFgZVY https://youtu.be/5rEZGSFgZVY
- wkat4242 3y ago
  Windows 11 copilot is not really the same thing though. They don't do something like homepods you can have around your house.
singularity2001 3y ago
The CallAnnie demo allows interruption and its such a leap forward compared to Siri

modeless 3y ago

Yeah when I was developing it, it quickly became apparent that I needed to be able to interrupt it. So I implemented that. Pretty easy to implement actually. Much harder would be to have the model interrupt the human. But I think it is actually desirable for natural conversation, so I do think a turn-taking model should be able to signal the LLM to interrupt the human.