4 ms·
> his A100 GPU (a $10,000 GPU) These are available to rent per hour at much lower costs. The author mentions this in the video description.
by callistus 3y ago
> his A100 GPU (a $10,000 GPU)
These are available to rent per hour at much lower costs. The author mentions this in the video description.
- Buttons840 3y agoTrue, as much as I enjoy owning and controlling my own hardware, buying an A100 and then letting it sit idle while I procrastinate and play video games probably isn't the best use of resources. He did say "my GPU" (or similar) at one point, and I thought maybe he does enough ML stuff that he bought his own.
- nl 3y agoIf you have an NVIDIA gaming GPU you can train reasonable transformers.
- oh_sigh 3y agoApproximately 40 cents USD for 15 minutes from cursory research.
- Buttons840 3y agoI'm completely unfamiliar with this market. Do you rent these on AWS? Or where?
- sva_ 3y agohttps://jarvislabs.ai/pricing/ https://jarvislabs.ai/pricing/ $1.29 per hour for a 40gb a100 apparently https://lambdalabs.com/service/gpu-cloud#pricing https://lambdalabs.com/service/gpu-cloud#pricing $1.10 per hour
- ranguna 3y agoIf you're ok with 24GB you can use a 3090 https://www.genesiscloud.com/pricing https://www.genesiscloud.com/pricing for 0.70$/h