2 ms·
Forget the GPUs, the top instance type here (g5.48xlarge) has 192 vCPUs! I'd love to get that in a compute-optimized instance type, without the GPUs. (The larg
by JoshTriplett 5y ago
Forget the GPUs, the top instance type here (g5.48xlarge) has 192 vCPUs! I'd love to get that in a compute-optimized instance type, without the GPUs.
(The largest available compute-optimized instance is currently the c6i.32xlarge at 128 vCPUs, not counting the absurd u-* family of instances that mere mortals can't get. 192 vCPUs would be a substantial upgrade; 256 would be even better.)
- rp1 5y agoJust out of curiosity, what workload do you have that requires so much compute? Could you move it to the gpu?
- titanomachy 5y agoI run batch computing jobs at >1000-CPU scale (I work at a large payment processing company). Being able to spread those cores across fewer physical nodes improves performance considerably. And no, GPUs aren't appropriate for this workload type. We're bound on IO and memory more than raw compute.
- JoshTriplett 5y agoSoftware compilation. And no, nobody's written a way to run massively parallel code generation/optimization on a GPU that I'm aware of.
- rp1 5y agoCould you split up the compilation to run over multiple nodes?
- JoshTriplett 5y agoWorking on that, but meanwhile, it's still faster and simpler to run it on bigger nodes.