4 ms·
It's because of a quirk of the hardware. The Unified Memory setup that Apple built into the M2 (and M1? not sure) systems means that you have high bandwidth an
by simcop2387 3y ago
It's because of a quirk of the hardware. The Unified Memory setup that Apple built into the M2 (and M1? not sure) systems means that you have high bandwidth and large amounts of memory available to the GPU inside them, which lets you run LLMs very efficiently, and very easily. Combined with the fact that that part of the hardware is the same across all the machines it makes for a very easy target to get a lot built with minimal effort.
- blitzar 3y agoQuirk / Deliberate design decision Potato / potato