3 ms·
That's going to be quite a while then because LLMs don't even perform well at anything close to the current context limit. They will miss important details whe
by fallingknife 3y ago
That's going to be quite a while then because LLMs don't even perform well at anything close to the current context limit. They will miss important details when the context gets over a couple thousand tokens.