3 ms·
The question is when Apple Laptops are going to be able to run LLMs with a performance comparable to what the AI companies are offering?
by elnatro 7mo ago
The question is when Apple Laptops are going to be able to run LLMs with a performance comparable to what the AI companies are offering?
- holtkam2 7mo agoNever - data centers will always offer more power if you only care about raw inference speed. HOWEVER I think that we'll reach the 'good enough' bar super soon. In 2-3 years I expect apple macs to be able to run a model as 'good' as Claude 4.6 sonnet at 90% of the inference speed we're used to from a cloud API. Yes, I'm sure by then there will be better models on offer via cloud providers, but idk if I'll even care. I'm not doing science / research or complex mathematical proofs, I just want a model good enough to vibe code personal projects for fun. So I think at that point I'll stop being a OpenAI / Anthropic customer.
- notenlish 7mo agoHow much ram would a model as good as sonnet 4.6 90% of the time require?
- bigyabai 7mo agoThe answer is "whenever Apple decides to sign CUDA drivers" at this point.