3 ms·

I have an M4 Mac with 128GB RAM and I'm currently downloading GLM-4.5-Air-q5-hi-mlx via LM Studio (80GB) and will report back!

• rexreed 1y ago
  How is it going? Intrigued enough to possibly get an M4 Mac with 128GB RAM if it's worthwhile...
  • ls-a 1y ago
    Apple is going to make so much money if they keep pushing on-device LLMs. It makes absolute sense to sell more macbook pros
    • pmarreck 1y ago
      Assuming they keep improving, yes. The one I tried (I responded to the other reply with some output, which was great) is as fast as the cloud ones and nearly as good.
  • pmarreck 1y ago
    Pretty impressive. Spit out perfectly-working Asteroids on the first try. https://gist.github.com/pmarreck/db782fdb68053292ca746d6c7569e2ac https://gist.github.com/pmarreck/db782fdb68053292ca746d6c756... I want to hook it up to Zed next and see how that goes