3 ms·
well an m5ad.24xlarge is 96 threads and 384G with your own 2xSSD (saves on EBS bandwidth costs). So fewer threads but a bit more memory. (we'll guess that is a
by ChuckMcM 6y ago
well an m5ad.24xlarge is 96 threads and 384G with your own 2xSSD (saves on EBS bandwidth costs). So fewer threads but a bit more memory. (we'll guess that is a 48 core EPYC 7642 equivalent with 96 threads since there is no 96 core version)
That bad boy costs $0.96/hr on the current spot prices (https://aws.amazon.com/ec2/spot/pricing/ https://aws.amazon.com/ec2/spot/pricing/)
- dmurray 6y agoHow does having your own SSD save on bandwidth? You have to send the data to and from the cores where the computation is taking place. There are certainly some workloads where it makes sense to own your own storage and rent computation, but you can't assume that by default for a "powerful AI" workload.
- cavisne 6y agoIt saves on bandwidth $ costs to EBS (AWS block storage)
- qayxc 6y agoThat instance type is missing the RTX 2080 Ti-equivalent GPU, though... The closest in performance to that GPU would be the V100 found in P3-instances.
- sabalaba 6y agoYea which are $3 / hour. Or, you could, shameless plug, use Lambda's GPU cloud which has V100s for $1.5 / hour! https://lambdalabs.com/service/gpu-cloud https://lambdalabs.com/service/gpu-cloud I'm embarrassed that I feel so compelled to post this--on a Friday night at that--I apologize.
- manjunaths 6y ago> I'm embarrassed that I feel so compelled to post this--on a Friday night at that--I apologize. Don't be. Finding gems like this is why some of us read the comments.
- 6510 6y agoFrowning on self-promotion got us in those silos.