3 ms·
How much can you quantize that down to run on a Mac Studio with 192GB? Is it possible? Feels like it would have to be 2bit…
by sroussey 2y ago
How much can you quantize that down to run on a Mac Studio with 192GB? Is it possible? Feels like it would have to be 2bit…
- Davidzheng 2y agoLess than 2bit i think. There's this IQ2 quant that fits