3 ms·
You are right of course.... IF your metric for manageable/useable is measured only tokens per second (tok/s). If your metric is quality of output, time, money
by monkmartinez 2y ago
You are right of course.... IF your metric for manageable/useable is measured only tokens per second (tok/s).
If your metric is quality of output, time, money and tok/s, there is no comparison; Local models just aren't there yet.