5 ms·
I don’t think that’s enough, cloud solutions are still cheaper and faster I believe
by eddiewithzato 3y ago
I don’t think that’s enough, cloud solutions are still cheaper and faster I believe
- cavisne 3y agoGaming class GPU's provide much better $/FLOPS (ie a 4090 is ~5x better value than a H100) https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/#GPU_Deep_Learning_Performance_per_Dollar https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni... Nvidia forces corporations to buy datacenter GPU's for CUDA licensing reasons, and adds a significant margin on top.
- eddiewithzato 3y agothis is not a 4090 and even then your article mentions experiments are better on a cloud solution. Where they only recommend getting a top of the line GPU if you are doing longer than a year work
- throwaway5959 3y agoI unfortunately don’t have $2000 to spend on a GPU. Would be nice though.