3 ms·
Some people at Apple see it. That’s why they added matmul to M5 GPU and keep mentioning LMStudio in their marketing.
by aurareturn 7mo ago
Some people at Apple see it. That’s why they added matmul to M5 GPU and keep mentioning LMStudio in their marketing.
- rudedogg 7mo agoTheir rule of only releasing major software updates once a year in June is holding them back IMO. Their local LLM apis were dated before macOS/iOS 26 was even released. Just because something worked 20 years ago doesn’t mean it works today, but I’m sure it’s hard to argue against a historically successful strategy internally.
- aurareturn 7mo agoHuh? What local LLM apis? It uses Metal.
- rudedogg 7mo agoThe application development APIs, ie: https://developer.apple.com/documentation/technologyoverviews/foundation-models https://developer.apple.com/documentation/technologyoverview...
- aurareturn 7mo agoAny serious LLM work isn't going to use that. They'll use Metal GPU. No one is going to inference using the NPU on a Mac. OP said "work stations" which is implying Macbook Pros and Studios.
- rudedogg 7mo ago> Any serious LLM work isn't going to use that. That’s my point. One would expect the platform owner (especially one where they own both the hardware AND software) to provide a reasonable / easy path to using LLMs if they are going to provide a framework for doing so. But Apple can’t because of how slow they ship updates