4 ms·
I think it works for info but not so well for instructions/guidance. That's why the standard advice is instructions at the start and repeated at the end.
by FeepingCreature 1y ago
I think it works for info but not so well for instructions/guidance. That's why the standard advice is instructions at the start and repeated at the end.
- raybb 1y agoI wonder if the serial-position effect is happening with LLMs. https://en.wikipedia.org/wiki/Serial-position_effect https://en.wikipedia.org/wiki/Serial-position_effect
- potatolicious 1y agoSomething like it definitely, though not exactly. We also know that recall improves with proximate position of bits within the context. Adherence to context is lossy in a way reminiscent of human behavior but also different in crucial ways.
- grogenaut 1y agoOr under the covers are just putting all the text you fed at into a rag database and doing embedding search define route and snippets and answer your questions when asked directly. Which is the difference approach than recalling instructions