I've been looking at the potential for Apple to make really interesting LLM hardware. Their unified memory model could be a real game-changer because NVidia rea

I've been looking at the potential for Apple to make really interesting LLM hardware. Their unified memory model could be a real game-changer because NVidia really forces market segmentation by limiting memory. It's worth adding the M3 Ultra has 819GB/s memory bandwidth [1]. For comparison the RTX 5090 is 1800GB/s [2]. That's still less but the M4 Mac Minis have 120-300GB/s and this will limit token throughput so 819GB/s is a vast improvement. For $9500 you can buy a M3 Ultra Mac Studio with 512GB of unified memory. I think that has massive potential. [1]: https://www.apple.com/mac-studio/specs/ https://www.apple.com/mac-studio/specs/ [2]: https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5090/ https://www.nvidia.com/en-us/geforce/graphics-cards/50-serie...