4 ms·
It looks like this requires 1.5TB of VRAM? Did I get that wrong? What would be the least unreasonable way you host this without quantizing it?
by nerdsniper 8mo ago
It looks like this requires 1.5TB of VRAM? Did I get that wrong? What would be the least unreasonable way you host this without quantizing it?
- Davidzheng 8mo ago3 m5 mac ultras with 512 each? idk