2 ms·

> M4 with a terabyte of RAM will run GPT-4 level models locally. No it won't. Apart from the fact that (if the article is correct), M4 will support maximum of

> M4 with a terabyte of RAM will run GPT-4 level models locally. No it won't. Apart from the fact that (if the article is correct), M4 will support maximum of 512 GB (and I don't want to know how many thousands of dollars you will have to spend on it given how much Apple wants you to pay for a difference between 8 GB and 16 GB MacBooks...), GPT-4-level models that you could run locally don't exist and it would be a challenge in itself to create them. The closest, Claude 3 Opus, as far as I can tell can't be run locally, and it is in nobody's interest to change this status quo (less capable models = run locally, powerful ones = pay us). I do hope this changes one day, but it is not directly related to M4 (or M5/M6).

modeless 3y ago
Apple can create them. They have the resources and can hire or acquire the expertise. And 512 GB should be more than enough for GPT-4 performance. We have invented a whole lot of techniques to reduce RAM requirements since GPT-4 was trained. Of course, GPT-5 and GPT-6 will come out and be better, but even just GPT-4 level performance will be enough for useful applications. And we will undoubtedly continue to discover ways to get better performance with less RAM. We've barely started optimizing these things.