2 ms·
As a company we operate a server with consumer cards. Running your own consumer Nvidia cards is very cheap compared to buying time on servers with enterprise Nv
by wongarsu 6y ago
As a company we operate a server with consumer cards. Running your own consumer Nvidia cards is very cheap compared to buying time on servers with enterprise Nvidia cards. On the cloud you are paying a premium for being on the cloud, and on top of that the premium for having datacenter-licenced cards.
Of course this calculation depends on how bursty your compute requirements are and how much you pay for electricity (datacenter cards are more power efficient)
- chrisjc 6y agoIsn't the proximity of your compute to your data a huge consideration too? I imagine that the egress data costs (cloud storage to your local GPU) could grow quite significantly if you're crunching enough data. I guess if you're rolling your own compute clusters, you've probably rolled your own storage solution too?