3 ms·
wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
by senectus1 2mo ago
wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
- fsuts 2mo agoDepends on your use case If running models then Apple is fine, if training or tuning or large number of users then Nvidia is king
- wmf 2mo agoTwo RTX 6000 have more FLOPS and more memory bandwidth than a M5 Ultra (but they also cost more).
- bigyabai 2mo agoIf your goal is pure GPU compute, you should have got a 5090. It can bench comparable to the RTX 6000 Pro cards and is near guaranteed to outperform M5 Ultra.
- rubyn00bie 2mo agoThere’s roughly 50% more memory bandwidth on an RTX 6000 pro versus the M5 Ultra. I imagine it really comes down to what you’re doing, I know my 5090 runs laps around the M5 Pro I have when it comes to local LLM performance (until it runs out of memory). If it wasn’t for the fact the 6000 Pro is selling for like 100% ($9,000) over MSRP it would probably look a lot more reasonable.