4 ms·Maybe if there was a 1-bit quant.by UncleOxidant 6mo agoMaybe if there was a 1-bit quant.barbacoa 6mo agoApple briefly was selling Mac studio with 512 GB of unified ram, meaning all that was available as vram.selcuka 6mo agoThere is an IQ1_S quant, but even that one is ~184GB (download size).