3 ms·
So that’s about 400 tok/sec. Times that by 3, you get 100k in under a minute. That’s doing nothing special and just using your current setup.
by conception 1mo ago
So that’s about 400 tok/sec. Times that by 3, you get 100k in under a minute. That’s doing nothing special and just using your current setup.
- ricardobeat 1mo ago150k is 2500 tokens/sec.