3 ms·
Mac is more competitive on power consumption though since its not ever pulling as much as a Nvidia GPU is my understanding. On that note you can rent an H100 f
by giancarlostoro 1y ago
Mac is more competitive on power consumption though since its not ever pulling as much as a Nvidia GPU is my understanding.
On that note you can rent an H100 for an hour for under $10 which might make for a slightly more interesting test, whats the best model outcome you can train in under an hour.
- dtnewman 1y ago> you can rent an H100 for an hour for under $10 Far cheaper these days. More like $2-3 for a consumer to do this. For bulk deals, pricing is often < $2.
- giancarlostoro 1y agoI couldnt remember offhand the exact amount but figured noting that under $10 is still impressive for one high end GPU for an entire hour.
- bigyabai 1y agoIt depends. If you're bottlenecked by memeory speed, the Mac typically comes out on-top. In terms of conpute efficiency though, Nvidia still has Apple beat. Nvidia wouldn't have the datacenter market on a leash if Apple was putting up a real fight.
- giancarlostoro 1y agoYeah, this is correct. My 3080 will render quicker than my M4 but my M4 will outcompete on being able to load larger models.