2 ms·
1 MBps is insanely fast for a method like this, it must be in the 100k tokens per second range. Probably with large batches.
by 0-_-0 2y ago
1 MBps is insanely fast for a method like this, it must be in the 100k tokens per second range. Probably with large batches.