2 ms·
If you want to be able to generate up to 128k tokens in one go successfully, then yes, that math checks out.
by coder543 10mo ago
If you want to be able to generate up to 128k tokens in one go successfully, then yes, that math checks out.
2 ms·