4 ms·
I think one of the hardest things about voice AI is being able to gracefully modulate between styles of input/output delay. In actual technical conversations so
by tunesmith 2y ago
I think one of the hardest things about voice AI is being able to gracefully modulate between styles of input/output delay. In actual technical conversations sometimes it is appropriate to patiently wait for someone to ask a very difficult question with delays in speech, and sometimes it is appropriate to interrupt regularly and ask brief pointed questions that require one-word answers, and everywhere in between. I'm really looking forward to having that kind of interchange with an LLM.
- za_mike157 2y agoyou are 100% correct! Here we just check if there is a pause of 200ms (you can change that in the code). I haven't seen any models that can detect if the user has finish speaking base on the question or social cues. You also don't want to make the delay so long since then it sound unnatural
- anvil-on-my-toe 2y agoI wonder if you need to account for body language to get that figured out. A technical conversation on the phone is usually not as fluid as in-person.
- euroderf 2y agoMaybe a variable-pressure PTT button for the user would be effective. Push harder or less hard depending on whether or not a word is on the tip of your tongue. The AI could appropriately interrupt or not.