2 ms·

But it's incredibly incapable compared to SOTA models. OP wants high quality output but doesn't need it fast. Your suggestion would mean slow AND low quality ou

But it's incredibly incapable compared to SOTA models. OP wants high quality output but doesn't need it fast. Your suggestion would mean slow AND low quality output.

kristjansson 8mo ago
Set your parameters to make that point then. “Yeah just run a 1T+ model on CPU”