3 ms·

For some reason, I find it really grating how most deep learning stuff are pretty much impossible to do without paying quite a bit to a 3rd party service by the

by spion 4y ago

For some reason, I find it really grating how most deep learning stuff are pretty much impossible to do without paying quite a bit to a 3rd party service by the hour. Its one of the rare things in computing that you can't get started with unless you have some significant resources - most other things you can theoretically do with any old laptop and internet connection (ok - you may need to pay once you get users, but not just to get started)

cweill 4y ago
Google colab is $49/mo to get an A100. Trust me when I say you can build multimillion-dollar ML companies with just that (and maybe $100 extra dollars per month of spot credits).
vorpalhex 4y ago
You can get a lot of success by buying used gpus of the right sort (usually pro gpus, not gaming cards). There is still cost in terms of power - gpus run hot and loud.
- askiiart 4y ago
  I bought a Tesla K80 for ~$200 off eBay, and now it's going for less than $150, and you can essentially get the same but just 1 GPU for $100. It has 12 GB of VRAM, and works great for "medium-duty" machine learning and AIs like Stable Diffusion. It does run hot (150W per GPU), and I've had to make a [custom solution to cool it](https://github.com/askiiart/k80-linux-cooling https://github.com/askiiart/k80-linux-cooling), but it works great considering the price. By the way, you can essentially never have an application use the 2 GPUs in parallel in any useful way; I'd suggest just getting a K20X instead.
izzygonzalez 4y ago
At certain scales that’s true but there’s plenty you can experiment with with just Colaboratory or Kaggle… at least to get some intuition before jumping to spending money.
riku_iki 4y ago
I think that model he trained can be trained on consumer RTX 3060, you just maybe would need to wait 4 times longer comparing to A100 he used.
mattnewton 4y ago
I’ve found Google’s Colab to be a pretty great deal for getting started and playing around.
cactusplant7374 4y ago
Runpod and Colab are the easiest to get started. Google cloud has a crazy sales funnel that will make you go crazy. $20 should get you pretty far I would think.

by spion 4y ago

cweill 4y ago

Google colab is $49/mo to get an A100. Trust me when I say you can build multimillion-dollar ML companies with just that (and maybe $100 extra dollars per month of spot credits).

vorpalhex 4y ago

You can get a lot of success by buying used gpus of the right sort (usually pro gpus, not gaming cards). There is still cost in terms of power - gpus run hot and loud.

askiiart 4y ago
I bought a Tesla K80 for ~$200 off eBay, and now it's going for less than $150, and you can essentially get the same but just 1 GPU for $100. It has 12 GB of VRAM, and works great for "medium-duty" machine learning and AIs like Stable Diffusion. It does run hot (150W per GPU), and I've had to make a [custom solution to cool it](https://github.com/askiiart/k80-linux-cooling https://github.com/askiiart/k80-linux-cooling), but it works great considering the price. By the way, you can essentially never have an application use the 2 GPUs in parallel in any useful way; I'd suggest just getting a K20X instead.

izzygonzalez 4y ago

At certain scales that’s true but there’s plenty you can experiment with with just Colaboratory or Kaggle… at least to get some intuition before jumping to spending money.

riku_iki 4y ago

I think that model he trained can be trained on consumer RTX 3060, you just maybe would need to wait 4 times longer comparing to A100 he used.

mattnewton 4y ago

I’ve found Google’s Colab to be a pretty great deal for getting started and playing around.

cactusplant7374 4y ago

Runpod and Colab are the easiest to get started. Google cloud has a crazy sales funnel that will make you go crazy. $20 should get you pretty far I would think.