3 ms·
Why would I buy this, vs. renting a cluster of ec2 gpu nodes?
by bagels 11y ago
Why would I buy this, vs. renting a cluster of ec2 gpu nodes?
- jfb 11y agoData locality and performance.
- modeless 11y agoThese GPUs are more than twice as fast as Amazon's GPUs. They also have 4x the memory and there is probably more GPU to GPU bandwidth as well. Doing deep learning on clusters is not practical yet due to bandwidth issues. If you want to train state-of-the-art models you need the biggest single machine you can get, and this is it.
- Sanddancer 11y agoLatency, support, specifications. The EC2 GPU nodes have less, slower, memory, graphics cards with half the performance and a third of the memory, and less drive space. Additionally, said compute resources are not next to you, which means certain things, like deep learning combined with AR are not possible. If you're just doing number crunching, you may be fine with EC2 instances, but any sort of realtime development, you probably want a supported platform right next to you.