3 ms·
but is it actually usable for anything if it's too slow. Has anyone has a ballpark number how many tokens per second we can get with this?
by tuananh 2y ago
but is it actually usable for anything if it's too slow.
Has anyone has a ballpark number how many tokens per second we can get with this?