3 ms·
Anecdotally, LLMs also get less intelligent when the context is filled up with a lot of irrelevant information.
by cubefox 1y ago
Anecdotally, LLMs also get less intelligent when the context is filled up with a lot of irrelevant information.
- taejavu 1y agoThis is well established at this point, it’s called “context rot”: https://research.trychroma.com/context-rot https://research.trychroma.com/context-rot
- cubefox 1y agoYeah, though this paper doesn't test any standard LLM benchmarks like GPQA diamond, SimpleQA, AIME 25, LiveCodeBench v5, etc. So it remains hard to tell how much intelligence is lost when the context is filled with irrelevant information.