4 ms·
It would run so slow it would be functionally unusable or at such a low quant that it wouldn't be useful for serious work.
by villish 4mo ago
It would run so slow it would be functionally unusable or at such a low quant that it wouldn't be useful for serious work.
- naasking 4mo agonvfp4 is pretty good, and with 4 machines you get a roughly 4x speedup using tensor parallelism.