3 ms·
The model will use the full context if it's been designed well, but you can still increase the size of the window on models where it hasn't. It's just pointless
by onion2k 1y ago
The model will use the full context if it's been designed well, but you can still increase the size of the window on models where it hasn't. It's just pointless. People who don't know much about LLMs will still think "bigger number is better" though.