3 ms·
Apple can create them. They have the resources and can hire or acquire the expertise. And 512 GB should be more than enough for GPT-4 performance. We have inven
by modeless 3y ago
Apple can create them. They have the resources and can hire or acquire the expertise. And 512 GB should be more than enough for GPT-4 performance. We have invented a whole lot of techniques to reduce RAM requirements since GPT-4 was trained. Of course, GPT-5 and GPT-6 will come out and be better, but even just GPT-4 level performance will be enough for useful applications. And we will undoubtedly continue to discover ways to get better performance with less RAM. We've barely started optimizing these things.