3 ms·

> Oh and don't get me started on MLX... Your pittance Apple gives you because they refuse to sign CUDA drivers? That MLX?

• sgt 1y ago
  If you're into LLM's you need to consider using Apple Silicon so you can continue developing on your own machine with MLX. MLX isn't just a replacemnet for CUDA, no way - it's made for the Apple arch. The new M5 chip will likely have serious ANE and ability to use the unified memory. Then we're talking powerhouse. Current Mac Studios are already more cost effective than say RTX 6000.
  • dham 1y ago
    That's just a unified memory architecture. Strix Halo has this, too. It's not only Apple. Memory bandwidth is lower than the ultra series but faster or on par for every other M series processor.
    • sgt 1y ago
      And it's great they are pushing each other. Strix Halo is based on Ryzen AI if I recall. My AI machine is currently Linux but I'd like to get a Mac Studio with an Ultra (or perhaps the M5 when it comes out) purely for the insane memory bandwidth.