3 ms·
While you're right that buying your own GPU makes a lot of sense for personal use or small tasks, if you factor in the cost of keeping a ML team waiting for the
by visarga 10y ago
While you're right that buying your own GPU makes a lot of sense for personal use or small tasks, if you factor in the cost of keeping a ML team waiting for the network to finish training, then it might be cheaper to invest $7000 and have it run in a few hours instead of weeks.
Also, consider the efficiency of owning such a 16 GPU beast: if you don't have tasks to run 100% of the time, then you're losing a lot by just keeping it idle. Cloud providers can reuse the same GPU for other clients in the meantime.