4 ms·
Sure, but would it interrupt with auto-complete nonsense too soon or would it know when an interruption would help? > This reminds me of >> A cool spring day?
by 8organicbits 3y ago
Sure, but would it interrupt with auto-complete nonsense too soon or would it know when an interruption would help?
> This reminds me of
>> A cool spring day?
> that movie where uhhh
>> Star Wars is a movie.
I'm human, so I can understand when I have enough info for a good guess (The Green Mile?) but that's a much different skill than what an LLM does, right?
- lucubratory 3y agoIn principle, understanding when it is appropriate to interrupt is the same sort of problem as understanding when it is appropriate to use a specific tool or API call. Both are deviations from natural language that the model has to decide to employ based on the context of the input, so yes it should be very possible for LLMs to do it. You're asking if they would do it well or if they would instead get it completely wrong and interrupt you all the time with irrelevant nonsense - I'm going to say that depends entirely on implementation. The bigger issue, in my opinion, is that current models running on current hardware at reasonable costs simply aren't performant enough to do the faster-than-speech prediction that is required to execute the concept well.