3 ms·
If you have a million Xs on the end of each line, when a human is looking at that file, he's not looking at the entirety of it, but only at the part that is act
by int_19h 2y ago
If you have a million Xs on the end of each line, when a human is looking at that file, he's not looking at the entirety of it, but only at the part that is actually visible on-screen, so the equivalent task for an LLM would be to feed it the same subset as input. In which case they can all answer this question just fine.
- br0tl1 2y agoI would also add that if I saw a file full of a million X's, I would not track each X as a distinct item in my mind, I would simplify the visual input down to "this is a file containing a lot of Xs" and work with that lightweight abstraction instead.
- est 2y ago> If you have a million Xs on the end of each line Hmm, I wonder if adding a compression layer during encoding helps?