4 ms·
So a minimum of 3x RTX Pro 6000 to run 1-bit at ~76% accuracy or MacStudio 512GB RAM to run 4-bit at ~97% accuracy.
by storus 4mo ago
So a minimum of 3x RTX Pro 6000 to run 1-bit at ~76% accuracy or MacStudio 512GB RAM to run 4-bit at ~97% accuracy.
- iaw 4mo agoNo. Unsloth has CPU offloading. It'll be slow but it'll work even with SSD offloading.