3 ms·
Specifically the M series from Apple have a very wide, very fast interface to DRAM, which is connected to DRAM chips soldered basically next to the CPU. That ma
by nine_k 9mo ago
Specifically the M series from Apple have a very wide, very fast interface to DRAM, which is connected to DRAM chips soldered basically next to the CPU. That makes it possible to use the entire unified RAM as the GPU RAM, and reasonably run decent ML models (for code, text, audio, pictures) locally. No CUDA, no kilowatt power supplies. This is the real differentiator.
- cromka 9mo agoNotably, this is also Qualcomm's X2 architecture.
- eqvinox 8mo ago> That makes it possible to use the entire unified RAM as the GPU RAM, and reasonably run decent ML models (for code, text, audio, pictures) locally. No CUDA, no kilowatt power supplies. This is the real differentiator. That might be relevant and a differentiator in your circles; it is entirely irrelevant in mine. Plain basic integer performance wins here.