3 ms·

Interesting, what are your laptop specs? I imagine the 33B Q8 to need a bit of memory - are you sharing VRAM and RAM?

• M4v3R 3y ago
  ARM based Macbooks with 48 GB of RAM or more are capable of running 33B models just fine, thanks to their "unified memory" architecture (single memory subsystem for RAM & VRAM).
• _boffin_ 3y ago
  M2 Max 64GB MBP 16"