3 ms·
This is a Mac thread. Virtually everyone is using a PC. I test between a HEDT Linux system and a recent Intel build on Windows 11. Took me around 8 hours to bu
by washadjeffmad 4y ago
This is a Mac thread. Virtually everyone is using a PC. I test between a HEDT Linux system and a recent Intel build on Windows 11.
Took me around 8 hours to build and deploy 4bit. 7B and 13B worked great, still working on the quantized 30B weights.