4 ms·
Yep. It’s expensive to spin up an A100 80GB instance but not THAT expensive. Oracles cloud offering (first thing to show up in google search I know you probably
by wincy 4y ago
Yep. It’s expensive to spin up an A100 80GB instance but not THAT expensive. Oracles cloud offering (first thing to show up in google search I know you probably won’t use them and it seems extra expensive) is $4.00 per hour. If you are motivated to screw around with this stuff there’s definitely options.
- gnramires 4y ago> If you are motivated to screw around with this stuff there’s definitely options. Erm, for inference that is. Training is definitely out of question for individuals I believe (unless you use much smaller models?).
- dilyevsky 4y agoGCP spot price for A100 80g gpu is only $1.25 and they give you $300 of credit when you open a new acc
- dragonwriter 4y agoUnless its for something you want to happen whenever and don't mind be dumped in process, shouldn't we look at on-demand, not spot, prices?
- dilyevsky 4y agoIt’s fine for testing it out or serving short queries. Your data can still remain on PV if the vm gets yanked