39 ms·
What is the memory bandwidth to the main CPU cores (not the "neural engine")? Is it really 120GB/s like they say in the spec sheet[0]? That's 20GB/s faster than
by energy123 2y ago
What is the memory bandwidth to the main CPU cores (not the "neural engine")? Is it really 120GB/s like they say in the spec sheet[0]? That's 20GB/s faster than the top dual-channel DDR5 desktops, which makes me think there might be some fine print I'm missing.
[0] https://www.apple.com/au/macbook-air/specs/ https://www.apple.com/au/macbook-air/specs/
- teaearlgraycold 2y agoIt uses HBM. It’s faster because it’s millimeters from the CPU/GPU and has a wide bus. If you think 120GB/s is high you should look up the Max/Ultra chips’ specs.
- Tepix 2y agoIt's LPDDR5X-7500 memory.
- teaearlgraycold 2y agoInteresting. Thanks!
- dannyw 2y agoYes, it is.
- int_19h 2y agoMemory bandwidth for M series goes up to 800 Gb/s for Ultra (in e.g. Mac Studio). That, combined with the ability to get it loaded with a lot of RAM, is what makes it so desirable for LLMs.