4 ms·
Apple has a huge legacy burden of defaulting laptops to 2010 levels of memory capacity at 8GB all the way up to mid 2024. All the great AI inference stuff in t
by cma 2y ago
Apple has a huge legacy burden of defaulting laptops to 2010 levels of memory capacity at 8GB all the way up to mid 2024. All the great AI inference stuff in the M-series is wasted due to that until you get ~80% penetration of the new 16GB min spec.
If they get compelling local inference throughout the OS it may help them drive adoption of new models faster, but App devs won't have incentive to integrate local AI stuff until there is more market penetration of the higher RAM capacities. Apple could perhaps monetarily incentivise them to make up for it. But I think they are just going to heavily have to lean on cloud for everything.
- threeseed 2y agoApple Intelligence is supported on any M1 Mac: https://www.apple.com/apple-intelligence https://www.apple.com/apple-intelligence And not sure there are many use cases for running mid-sized models locally. Smaller models fit in 8GB and work fine for action handling, tagging, classification etc. And for text/image generation you just get such a better user experience using a cloud hosted model.
- cma 2y agoFit in 8GB while running browsers and other apps that would want AI? Only tiny models that also work on phones.