3 ms·
Is it possible for a non-Apple-silicon Mac with eGPU to get faster than a maxed out M2? When working with LLMs, inference speed is crucial and M2 Ultra is not
by behnamoh 3y ago
Is it possible for a non-Apple-silicon Mac with eGPU to get faster than a maxed out M2?
When working with LLMs, inference speed is crucial and M2 Ultra is not there yet.
- firecall 3y agoYou can more powerful / faster GPUs in an Intel Mac Pro than the M2 Ultra GPU for sure. I do recall a while back Nvidia did release updated MacOS drivers, but I’m not sure of the state of those on modern macOS. But it certainly was possible to run an NVIDIA eGPU at some point.
- pram 3y agoDepends but no, only AMD cards are supported (in MacOS) for eGPU and they're all slow as hell too (for inference)