3 ms·
> single RTX 3080 20G, I got 10 tok/s initially Add $200, buy a used 3060 and you won't need to offload cache to RAM. Yo'd have like 50-60 t/s with MTP enabled
by BoredomIsFun 28d ago
> single RTX 3080 20G, I got 10 tok/s initially
Add $200, buy a used 3060 and you won't need to offload cache to RAM. Yo'd have like 50-60 t/s with MTP enabled.
- jan_Sate 28d agoaww. I used to have a 3060 and I upgraded to this 3080 20G. Maybe it's time for me to get a 3060 back again. :P