3 ms·
As far as I understand it, context length degrades llm performance, so just because an llm "supports" a large context length it basically just clips a top and b
by qudat 2y ago
As far as I understand it, context length degrades llm performance, so just because an llm "supports" a large context length it basically just clips a top and bottom chunk and skips over the middle bits.