4 ms·
It would probably be worth finding a more friendly way to market this, but it's a reasonable / accurate way to say it. The prompt processing sped up. Not the
by jasonjmcghee 8mo ago
It would probably be worth finding a more friendly way to market this, but it's a reasonable / accurate way to say it.
The prompt processing sped up.
Not the output generation.
M4 was notoriously slow at this compared to DGX etc.