4 ms·
> Rumors seem to be that the M7 is the generation that Apple is looking to push AI performance much further. What specifically does that mean? The M5 series h
by Dylan16807 2mo ago
> Rumors seem to be that the M7 is the generation that Apple is looking to push AI performance much further.
What specifically does that mean? The M5 series has 10 cores per 128 bits of memory bus; are the cores unable to keep up with the RAM? I thought they did and memory bandwidth was usually the bottleneck. But the memory bus is already very highly clocked and goes up to 1024 bits wide so it's hard to picture memory bandwidth having a huge leap.
- deleted 2mo ago[deleted]
- kristianp 2mo agoLLMs token generation is memory bandwidth constrained. If the M7 has double the memory bandwidth as some speculate [1], then it will help with LLM performance. There is also expectation (possibly unfounded) that the GPU will have improved matrix performance to help prompt processing as well. [1] "LPDDR6 is coming." - https://news.ycombinator.com/item?id=49436849 https://news.ycombinator.com/item?id=49436849
- Dylan16807 2mo ago14GT/s is a goal but it might be a while, I think 11-12 is more likely in that time frame. 50% more pins... we'll see. If they can reasonably make that fit then even more shame upon the traditional desktop CPU makers for sticking with 128 bits for so long.