3 ms·

I was thinking the other day that it’s taken OpenAI quite a bit of time to bring out GPT-4o for free to users. Even paying users have limits of how much they co

I was thinking the other day that it’s taken OpenAI quite a bit of time to bring out GPT-4o for free to users. Even paying users have limits of how much they could use GTP-4 and GPT-4 Turbo. For Apple to build out a dedicated server farm to accommodate even 50% of all their current users would be extremely challenging. I think they need users to run an LLM locally just simply because they wouldn’t be able to handle the amount of compute it would require to handle every request server-side. I’m very interesting to see how local AI will impact the amount of RAM that comes standard with their Macs and iPhones. The 12 year old Macbook I still have in a cupboard somewhere has 16 GB of RAM. That was max at the time, but today 128 GB is max while they still offer 8 GB. If they had done that 12 years ago they would have been offering 1, 2, 4, 8 and 16 GB of memory.

epolanski 2y ago
Yep, same here. 2012 MBP with 16GBs and they trying to sell me 8Gbs MBP as base in 2024..
paulmd 2y ago
> For Apple to build out a dedicated server farm to accommodate even 50% of all their current users would be extremely challenging fyi there have been rumors that apple is looking to scale out Mac Pro production for their own server farms to support this. Since ultra is a super niche product normally this obviously is going to be like, several orders of magnitude of increase here. Obviously there is the conventional wisdom that apple doesn’t do server and the server market doesn’t do apple, and they may continue to prefer commodity/off-the-shelf server hardware for the bulk of their iCloud infra, but things may be different with the bottleneck on AI hardware at the moment.