3 ms·
341 is two orders of magnitude faster than your 1 tok/s so it doesn’t seem like their stuff is all that obvious. I also have no baseline for training to know if
by vlovich123 7mo ago
341 is two orders of magnitude faster than your 1 tok/s so it doesn’t seem like their stuff is all that obvious. I also have no baseline for training to know if 341tok/s is slow but it seems speedy for a 3090.
- bastawhiz 7mo agoOP said 1k, not 1
- rolandr 7mo ago1k tok/s = 1000 tok/s...
- SubiculumCode 7mo ago:) Coffee is good
- thrawa8387336 7mo agoOOM is log10