3 ms·
Claude's context is 100K not 1M [1]. If you're somehow shoving in a million tokens that could explain the issue you're having! [1] https://www.anthropic.com/in
by l1n 3y ago
Claude's context is 100K not 1M [1]. If you're somehow shoving in a million tokens that could explain the issue you're having!
[1] https://www.anthropic.com/index/100k-context-windows https://www.anthropic.com/index/100k-context-windows
- gamegoblin 3y agoMisremembered, the main thrust of the comment still stands, the 100K context window isn't "real", it would be absurdly expensive to do it for real. They are using a lot of approximation tricks to get there.
- phillipcarter 3y agoYep, mistype on my end as well. Claude just fails to process the request if you get above 100k tokens (I've done that, heh).