3 ms·
These benchmarks are for the older 7B model, now known as "Tiny". It does not include the 8x7B "Small" model, or the API-only "Medium".
by sp332 3y ago
These benchmarks are for the older 7B model, now known as "Tiny". It does not include the 8x7B "Small" model, or the API-only "Medium".