5 ms·
If you're into LLM's you need to consider using Apple Silicon so you can continue developing on your own machine with MLX. MLX isn't just a replacemnet for CUD
by sgt 1y ago
If you're into LLM's you need to consider using Apple Silicon so you can continue developing on your own machine with MLX. MLX isn't just a replacemnet for CUDA, no way - it's made for the Apple arch. The new M5 chip will likely have serious ANE and ability to use the unified memory. Then we're talking powerhouse. Current Mac Studios are already more cost effective than say RTX 6000.
- dham 1y agoThat's just a unified memory architecture. Strix Halo has this, too. It's not only Apple. Memory bandwidth is lower than the ultra series but faster or on par for every other M series processor.
- sgt 1y agoAnd it's great they are pushing each other. Strix Halo is based on Ryzen AI if I recall. My AI machine is currently Linux but I'd like to get a Mac Studio with an Ultra (or perhaps the M5 when it comes out) purely for the insane memory bandwidth.