3 ms·
And you can run quantized versions on old hardware! Like 10 year old hardware. You might only get 3 tokens/sec, but it works.
by Aerroon 8mo ago
And you can run quantized versions on old hardware! Like 10 year old hardware. You might only get 3 tokens/sec, but it works.