3 ms·
Sometimes, type enough tokens and they no longer have any prior words written by the LLM in their context. Similarly the algorithms would still happily respon
by Retric 3y ago
Sometimes, type enough tokens and they no longer have any prior words written by the LLM in their context. Similarly the algorithms would still happily respond if some different and potentially completely unrelated LLM wrote the prior responses.
LLM’s are really best thought of as improv actors. The prompt is in effect just the current skit being preformed. The intentions of the character being played doesn’t imply the actor always has those intentions. So yes they can run through a knock knock joke across multiple prompts, but the need not have written the start of a joke to be able to make up an ending.
- l33tman 3y agoI agree, there is a current technical limit in the token context but that's a limit in practice, not in theory. There are plenty of wrapper tools around LLMs that cleverly use the token window to keep a longer "state of mind", overall strategies currently executing etc. With varying degrees of success, I should say... but still, it's kind of analogous to a human executing a strategy with intentions.