2 ms·
It’s already possible. I can’t find the thread now, but I saw a demo on X recently where they had an LLM hooked up to a text field where every character typed w
by JimDabell 3y ago
It’s already possible. I can’t find the thread now, but I saw a demo on X recently where they had an LLM hooked up to a text field where every character typed was sent to the LLM immediately so that it could anticipate responses and do some planning ahead of time. You’re basically talking about the same thing except for the fact that one of the possible outputs for the LLM is an interrupt function call.
Edit: anotheryou found the thread here:
https://twitter.com/yoheinakajima/status/1762718034761072653 https://twitter.com/yoheinakajima/status/1762718034761072653