4 ms·
We can do it for way less using spot instances on AWS, though it takes longer.
by xwdv 4y ago
We can do it for way less using spot instances on AWS, though it takes longer.
- WatchDog 4y agoAWS don't have any GPU spot instances right? I highly doubt you could get anywhere near the same price.
- WatchDog 4y agoVery very rough estimate, using inference benchmarks, which can't necessarily be extrapolated to training, but if a A100 takes 6.49 seconds to generate an image, and a EPYC 7352 24-core cpu takes 223.19 seconds[0], that's 34 times slower. So you would need at least 2,716,796 hours to train on CPU. A m6a.12xlarge is roughly equivalent to a EPYC 7352 24-core[1], it currently costs $0.5028 an hour on spot. So that works out to a cost of $1,366,005. [0]: https://lambdalabs.com/blog/inference-benchmark-stable-diffusion https://lambdalabs.com/blog/inference-benchmark-stable-diffu... [1]: https://browser.geekbench.com/v5/cpu/compare/17529628?baseline=19972119 https://browser.geekbench.com/v5/cpu/compare/17529628?baseli...