3 ms·
I heard, the middle of the context is often ignored. Do long context windows make much sense then or is this just a way of getting people to use more tokens?
by k__ 7mo ago
I heard, the middle of the context is often ignored.
Do long context windows make much sense then or is this just a way of getting people to use more tokens?