4 ms·
There is a lot of emerging evidence that ability to reason, and ability to compare within-context dramatically declines with large context. It is unable to fin
by mediaman 3y ago
There is a lot of emerging evidence that ability to reason, and ability to compare within-context dramatically declines with large context.
It is unable to find edits: https://twitter.com/mengdi_en/status/1763338245696274469 https://twitter.com/mengdi_en/status/1763338245696274469
It hallucinates changes badly: https://twitter.com/thomasahle/status/1763408041960231010 https://twitter.com/thomasahle/status/1763408041960231010
To be fair, finding diffs is an odd way to use LLMs, but does show the highly variable abilities of these models over bigger contexts.
In other models, reasoning performance declines with more tokens (no data yet here for Gemini 1.5 Pro): https://arxiv.org/html/2402.14848v1 https://arxiv.org/html/2402.14848v1
Note in that last chart that significant declines in reasoning are apparent over just a few thousand tokens.
- panarky 3y agoI took the text of Macbeth and changed the dialect of one line: Original: "The rest, that are within the note of expectation, alreadie are i'th' Court" New: "It looks like everyone is here already" Then I gave the entire text to Gemini, ~400000 tokens, and asked it to analyze the play's diction and style, and to identify any lines that didn't match the prevailing dialect. It found that one line I'd changed.
- interstice 3y agoIsn’t it quite likely it already had the whole text from its training data? Which might make it a bit of a different case.
- panarky 3y agoI was responding to the assertion that the "ability to compare within-context dramatically declines with large context". My test demonstrates that even with a large context, Gemini 1.5 finds the needle in the haystack. And it's not even searching for specific terms or meanings, the only clues are subtle differences in style and diction.
- dontupvoteme 3y agoI'm not surprised, those documents probably contain a lot of information which causes the model to get confused/lost/etc. It also seems to line up with random paragraph location doing the worst in that paper.