10 ms·
Additionally, the more information you put into the context the more confused the LLM will get, if you did dump the whole codebase into the context it would not
by ehnto 1y ago
Additionally, the more information you put into the context the more confused the LLM will get, if you did dump the whole codebase into the context it would not suddenly understand the whole thing. It is still an LLM, all you have done is polluted the context with a million lines of unrelated code, and some lines of related code, which it will struggle to find in the noise (in my experience of much smaller experiments)
- Bombthecat 1y agoI call this context decay. :) The bigger the context, the more stuff "decays" sometimes to complete different meanings