4 ms·
The benchmark says the fastest model takes 0.3s for 20 tokens. Does this mean it would take 30 seconds for 2000 tokens?
by collaborative 3y ago
The benchmark says the fastest model takes 0.3s for 20 tokens. Does this mean it would take 30 seconds for 2000 tokens?