3 ms·
Yeah, or you can get a gpu server with 20GB VRAM on hetzner for ~200 EUR per month. Runpod and DigitalOcean are also quite competitive on prices if you need a d
by jokethrowaway 2y ago
Yeah, or you can get a gpu server with 20GB VRAM on hetzner for ~200 EUR per month.
Runpod and DigitalOcean are also quite competitive on prices if you need a different GPU.
AWS is stupidly expensive.
- hereonout2 2y agoExpensive in general but combine some decent tooling and spot instances and it can be insanely cheap. The latest Nvidia L4 GPUs (24GB) instances are currently less than 15c p/h spot. T4s are around 20c per hour spot, though they are smaller and slower. I've been provisioning hundreds of these at a time to do large batch jobs at a fraction of the price of commercial solutions (i.e. 10-100x cheaper). Any problem that fits in a smaller GPU and can be expressed as a batch job using spot instances can be done very cheaply on AWS.