4 ms·
You still need the hardware I've got a 128GB strix halo staying warm at home, it has nothing on top models with big budget. It's good supplement to low end pla
by __s 5mo ago
You still need the hardware
I've got a 128GB strix halo staying warm at home, it has nothing on top models with big budget. It's good supplement to low end plans for offloading grunt work / initial triage
- manmal 5mo agoHave you looked into DwarfStar 4?
- __s 5mo agoBeen away from home for nearly a month, so was mostly going off Qwen 3.5 122b-a10b (Q4?) / Qwen 3.6 35b-a3b (Q8) / Gemma4 31b (Q8) Thanks for suggestion tho, tool by antirez is always going to pique interest, I'll check it out when I'm finally home again Tho says Metal / CUDA, so doesn't seem friendly to Linux AMD system
- manmal 5mo agoHis quant that fits into 128GB looks interesting for Spark DGX as well IMO.