3 ms·
The next mac Ultra will allow to run a big model locally with acceptable speed. But we need people to optimize it for that computer, and we’ll be more limited i
by ttoinou 3mo ago
The next mac Ultra will allow to run a big model locally with acceptable speed. But we need people to optimize it for that computer, and we’ll be more limited in models we can choose from
128GB is enough to run a large model, quantized, REAPed, with MoE and fast SSD for model weights
- Davidzheng 3mo agoNot Kimi K3 large though
- KerrAvon 3mo ago128 isn't enough, but if this report is accurate, the next Mac Studio could run it https://www.macrumors.com/2026/06/25/m5-ultra-mac-studio-2026/ https://www.macrumors.com/2026/06/25/m5-ultra-mac-studio-202...
- jayd16 3mo agoThey'll just have you buy two studios and thunderbolt them together.