4 ms·
The cost of GPUs doesn't make sense for the compute they offer. According the benchmark, the fastest 8 GPU node takes about 0.5 seconds. The cost of that node
by sacheendra 8y ago
The cost of GPUs doesn't make sense for the compute they offer.
According the benchmark, the fastest 8 GPU node takes about 0.5 seconds. The cost of that node on AWS is about 24$/hour. The 21 node spark cluster takes 6 seconds. But, it only costs 4$/hour.
An additional benefit with Spark is that it can be used for a lot more variety of operations than a GPU.
This cost disadvantage restricts GPU processing to niche use cases.
- TomVDB 8y ago> According the benchmark, the fastest 8 GPU node takes about 0.5 seconds. The cost of that node on AWS is about 24$/hour. The 21 node spark cluster takes 6 seconds. But, it only costs 4$/hour. Using your numbers, the GPU solution has half the cost for similar performance? How does that not make sense? > This cost disadvantage restricts GPU processing to niche use cases. All GPU compute applications are niche use cases.
- johnvanommen 8y agoLook man, you don't get it. The GPU case is half the cost, but it's also twelve times faster. Oh, wait...
- latchkey 8y ago> The cost of GPUs doesn't make sense for the compute they offer. This assumes AWS pricing. You build a farm of GPUs and buy in bulk, you get much better cost basis. GPU farms are becoming more and more of a thing now and definitely less 'niche'.