4 ms·
30B is useless on 24 gigs of ram as there's ~4 gigs of ram left for everything else even with unsloth quants
by piyh 15d ago
30B is useless on 24 gigs of ram as there's ~4 gigs of ram left for everything else even with unsloth quants
loading thread…