3 ms·
Andrej Karpathy talked about how our DeepLearning11 build (8x 1080 Ti's) had a ~3 month payback period versus AWS In 2017. Currently you can rent 8xA100 server
by p1esk 4y ago
Andrej Karpathy talked about how our DeepLearning11 build (8x 1080 Ti's) had a ~3 month payback period versus AWS
In 2017. Currently you can rent 8xA100 server for $8.8/hr: https://lambdalabs.com/service/gpu-cloud https://lambdalabs.com/service/gpu-cloud
At this price the payback stretches to about 3 years (taking into account average energy costs in US, and assuming 24/7 operation for the whole 3 years).
- TOMDM 4y agoA bit of extra context, that's $8.8/hr for the 40GB A100's The 80GB A100's will run you $12.0/hr for 8 of them.
- fancyfredbot 4y agoThat's 24k over 3 months which would buy and power 8 4090 GPUs by my reckoning. Of course those 8 4090s wouldn't have enough memory to run chatGPT so maybe AWS is good value after all.
- TOMDM 4y agoThis is Lambda Labs' pricing, which is significantly cheaper than AWS.