3 ms·
A local model generating 20 tokens/sec today could potentially reach 40 tokens/sec in many scenarios.
by thomasthelliez 5mo ago
A local model generating 20 tokens/sec today could potentially reach 40 tokens/sec in many scenarios.
loading thread…