3 ms·
Only if you go above 200k, which is a) standard with other model providers and b) intuitive as compute scales with context length.
by minimaxir 9mo ago
Only if you go above 200k, which is a) standard with other model providers and b) intuitive as compute scales with context length.