4 ms·
> Surely running local LLMs isn’t that big a market. Agreed. That said, if you do AI/LLMs, few, if any, portable non-Mac systems have the ability to pull this
by binkHN 3y ago
> Surely running local LLMs isn’t that big a market.
Agreed. That said, if you do AI/LLMs, few, if any, portable non-Mac systems have the ability to pull this off. The Macs just crush it when it comes to GPU and memory bandwidth performance, and they do this while sipping battery life.