2 ms·
> single-request decode speed is now the metric that matters Benched at 96 input tokens, 4000 output tokens.
by Terretta 5mo ago
> single-request decode speed is now the metric that matters
Benched at 96 input tokens, 4000 output tokens.
loading thread…