4 ms·
At a very generous 50 tokens per second doesn't that still leave you with more than two and a half minutes (160s) processing time per document?
by LunaSea 2y ago
At a very generous 50 tokens per second doesn't that still leave you with more than two and a half minutes (160s) processing time per document?