3 ms·
man, that is really really quick. What is your desktop setup??? GPU?
by abrookewood 7mo ago
man, that is really really quick. What is your desktop setup??? GPU?
- jjcm 7mo agoIt is fast, but I do have good hardware. A few people have asked for my local inference build, so I have an existing guide that mirrors my setup: https://non.io/Local-inference-build https://non.io/Local-inference-build