3 ms·
AWS is absolutely not cheap, and never has been. You want to look for the hetzner of the GPU world like runpod.io where they are $2 an hour, so $16/hr for 8, th
by zipy124 1y ago
AWS is absolutely not cheap, and never has been. You want to look for the hetzner of the GPU world like runpod.io where they are $2 an hour, so $16/hr for 8, that's already half of aws. You can also get a volume discount if you're looking for 96 almost certainly.
An H100 costs about $32k, amortized over 3-5 years gives $1.21 to $0.7 per hour, so adding in electricity costs and cpu/ram etc... runpod.io is running much closer to the actual cost compared to AWS.
- fooker 1y agoH100 was 32k three years ago. Significantly cheaper now that most cloud providers are buying Blackwell.
- mountainriver 1y agoRunpods network is the worst I’ve ever seen, their infra in general is terrible. It was started by comcast execs, go figure. Their GPU availability is amazing though
- thundergolfer 1y agoIs the network just slow, or just it have outages?
- mountainriver 1y agosuper slow