4 ms·
This is a brilliant analogy.[a] It does a really good job of conveying the fact that current LLMs have a horrendously inefficient method for achieving somethin
by cs702 4y ago
This is a brilliant analogy.[a]
It does a really good job of conveying the fact that current LLMs have a horrendously inefficient method for achieving something resembling working+long-term memory: They need someone else to write code that
* stores in advance all possible pieces of text that might be be relevant to future prompts;
* finds and retrieves at runtime the pieces of text that are supposedly most relevant to a prompt; and
* tacks on those supposedly most relevant pieces of text as a contextual preamble to each new prompt (query).
Current LLMs truly are Leonard-Like Models.
Surely there must be a better way... but it hasn't been discovered yet.
--
[a] I saw "Memento" years ago and still remember it vividly. It was written and directed by a young Christopher Nolan.
- shkurski_ 4y agoExactly! What could be the next step is removing the (user-facing) prompt at all, since (presumably) there should be enough data for this part to be proactive.