3 ms·
i have this exact same machine and 3.8-27b runs well, albeit slow at about 6 t/s. i have it complete tasks in the background as i work on other things. for co
by dstryr 2mo ago
i have this exact same machine and 3.8-27b runs well, albeit slow at about 6 t/s.
i have it complete tasks in the background as i work on other things.
for comparison, my 3090 runs it at about 60 t/s.
- romeinaday 2mo agoWhat are you using to run the model and as coding harness?
- dstryr 2mo agollama.cpp + pi.dev