4 ms·
No need to spend $30k, use Azure or AWS.
by DeathArrow 4y ago
No need to spend $30k, use Azure or AWS.
- wincy 4y agoYep. It’s expensive to spin up an A100 80GB instance but not THAT expensive. Oracles cloud offering (first thing to show up in google search I know you probably won’t use them and it seems extra expensive) is $4.00 per hour. If you are motivated to screw around with this stuff there’s definitely options.
- gnramires 4y ago> If you are motivated to screw around with this stuff there’s definitely options. Erm, for inference that is. Training is definitely out of question for individuals I believe (unless you use much smaller models?).
- dilyevsky 4y agoGCP spot price for A100 80g gpu is only $1.25 and they give you $300 of credit when you open a new acc
- dragonwriter 4y agoUnless its for something you want to happen whenever and don't mind be dumped in process, shouldn't we look at on-demand, not spot, prices?
- dilyevsky 4y agoIt’s fine for testing it out or serving short queries. Your data can still remain on PV if the vm gets yanked
- vintermann 4y agoI can see some issues with uploading a leaked model to a cloud provider.