2 ms·
What's the horizon after which you reset the input instead of appending to it? Does that happen if the user lets the system finish speaking?
by thom 3y ago
What's the horizon after which you reset the input instead of appending to it? Does that happen if the user lets the system finish speaking?
- modeless 3y agoGreat question. Right now that happens, somewhat arbitrarily, if the user lets the system finish speaking the first sentence of its response. If the user interrupts before that, then it's considered a continuation of the previous input. If the user interrupts after that, it's still an interruption (and, importantly, the language model's response must be truncated in the conversation context because the user didn't hear it all), but it starts a new input to the LLM. This could be handled better as well. Basically any heuristics like this that are in the system should eventually be subsumed into the AI models so that they can be responsive to the conversation context.