5 ms·
Forget cloud GPUs. It makes much more sense from every perspective to buy them and put them in your bedroom. Cloud GPUs are slow, VERY expensive and not even
by andrewstuart 4y ago
Forget cloud GPUs.
It makes much more sense from every perspective to buy them and put them in your bedroom.
Cloud GPUs are slow, VERY expensive and not even available.
You shouldn't need the superstar power of being John Carmack to get access to computing resources.
The promise of the cloud is for the most part, sssnake oil.
- xxpor 4y agoHow could a cloud GPU that's a specific model be any different in speed from the same thing in your bedroom, if you could get nvidia to even sell you one in the first place?
- MasterScrat 4y agoThey're probably alluding to the large number of GPU models available to retail customers which are not allowed in datacenters.
- xxpor 4y agoThen they're completely missing the point of the cloud GPUs. If you're not running something that needs NCCL et al, yeah, go run something under your desk.
- MasterScrat 4y ago4090s support NCCL and are not allowed in datacenters
- andrewstuart 4y agoCloud GPUs aren't better.
- andrewstuart 4y agoThe consumer GPUs are much faster, cheaper and more available than most of the cloud GPUs.
- dekhn 4y agoBe specific about which models you're comparing. One of the big deals about data center GPUs is that they have a lot of RAM, more than any consumer card.
- NBJack 4y agoAvailability on the market vs your wallet. Power consumption vs how much power you can safely draw from an outlet in your apartment/home/place before a breaker trips. Massive waste heat vs your native climate and whatever your place is capable of offering (i.e. AC). Anecdotally, having a single high powered modern GPU in my office generates enough heat that it is in part why I keep a temperature monitor on my desk to ensure I'm not cooking myself. Having more than one gets far more interesting.
- czx4f4bd 4y agoI suspect John Carmack is aware of the tradeoffs and has better things to do with his time than procure $50k+ worth of compute resources, rack and stack them in his bedroom, provision them, implement configuration management, orchestration, and monitoring, keep them running over time, etc., etc., etc.
- andrewstuart 4y agoIt's fiction that moving to the cloud removes most of the complexity of running computer systems.