3 ms·
It's just crazy how much it costs to train such models. As I undestand 800 A100 cards would cost about 25.000.000 without considering the energy costs for 61 da
by MichaelRazum 4y ago
It's just crazy how much it costs to train such models. As I undestand 800 A100 cards would cost about 25.000.000 without considering the energy costs for 61 days of training.
- refulgentis 4y ago16,000,000 at MSRP
- StevenWaterman 4y agoLambda labs will rent you an 8xA100 instance for 3 months for $21,900. That would put it at around $2m
- MichaelRazum 4y agoStill a bit to expensive for my sideproject ; ) To be honest it seems only big corp can do that kind of stuff. By the way if try to do hyper parameter tuning or some exploration in the architecture it becomes guess 10x or 100x more expensive.
- bmcahren 4y agoAWS has them in US-EAST1 for $9.83/hr spot with 96 CPU cores, 1152GB of ram, 8 A100s with 320 GB of RAM, 8TB of NVME, and 19 Gbps of EBS bandwidth to load your data quickly. https://aws.amazon.com/ec2/instance-types/p4/ https://aws.amazon.com/ec2/instance-types/p4/ p4d.24xlarge An alternative is the p3.16xlarge for 8 V100s with 256GB of GPU RAM but you might as well get the A100s since it's only $0.50/hr cheaper
- semitones 4y agohttps://coreweave.com/ https://coreweave.com/ offers some of the cheapest GPU compute out there