4 ms·
At first I thought, it sounded crazy but then I realized that reports have told us that the M4 will be a key part of Apple’s reneweed AI strategy for 2024. The
by retskrad 2y ago
At first I thought, it sounded crazy but then I realized that reports have told us that the M4 will be a key part of Apple’s reneweed AI strategy for 2024. The A18 and M4 in the iPhone 16 and the M4 MacBook Pros at the ens of this year will have much better neural engines to drive Apple’s WWDC 2024 AI features. Apple can’t leave the iPad Pro out to dry.
- aurareturn 2y agoFor the first time in a long time, consumer hardware is not even close to being fast enough for a new type of mass applications: GenAI. People have stopped caring about consumer chips because they have been "good enough" for a long time. Hardware is getting exciting again. We need significantly more compute, memory bandwidth, and memory capacity. There are huge bottlenecks everywhere.
- wvenable 2y agoFor GenAI, I wonder if we need consumer hardware to be that powerful. Isn't this exactly what "the cloud" is for?
- aurareturn 2y agoI think the best models will always require "the cloud" but there will be plenty of use cases where "good enough" local LLMs need to be on-device.
- kmeisthax 2y agoIt depends. If you're OpenAI, consumer hardware should never be powerful enough to run local models. If you're Apple, it should.