3 ms·
Sure, but apart from the detail that you can make them pause by not feeding them words, you can't technically argue that they lack all those things. They are st
by l33tman 3y ago
Sure, but apart from the detail that you can make them pause by not feeding them words, you can't technically argue that they lack all those things. They are stateful in the sense that they see what they write, so they can keep their inner plan and state in that way across word-iterations. They for sure work differently than a human brain, but without further pretty deep analysis you can't really claim that they can't reproduce similar traits using the mechanism.
- Retric 3y agoSometimes, type enough tokens and they no longer have any prior words written by the LLM in their context. Similarly the algorithms would still happily respond if some different and potentially completely unrelated LLM wrote the prior responses. LLM’s are really best thought of as improv actors. The prompt is in effect just the current skit being preformed. The intentions of the character being played doesn’t imply the actor always has those intentions. So yes they can run through a knock knock joke across multiple prompts, but the need not have written the start of a joke to be able to make up an ending.
- l33tman 3y agoI agree, there is a current technical limit in the token context but that's a limit in practice, not in theory. There are plenty of wrapper tools around LLMs that cleverly use the token window to keep a longer "state of mind", overall strategies currently executing etc. With varying degrees of success, I should say... but still, it's kind of analogous to a human executing a strategy with intentions.