4 ms·

Google Provides Free Nvidia K80 GPUs for Anyone to Train Deep Learning Models

92 points by williamtrask 9y ago

fwdpropaganda 9y ago
This Free Nvidia GPUs that you mention... is that what Colaboratory is?
cstpdk 9y ago
Providing a tl;dr: Google provides a jupyter / ipython research environment with some amount of integration to their existing services. This environment they call "Colaboratory". They have now started providing free access to GPU resources from within this environment. Details for using with tensorflow here: https://colab.research.google.com/notebook#fileId=/v2/external/notebooks/gpu.ipynb https://colab.research.google.com/notebook#fileId=/v2/extern...
- joe_the_user 9y ago
  Some bad headlines are worse the other bad headlines. And this one is fake-promising free candy of a brand I want.
- forestgreen 9y ago
  Anybody know how to upload large data files into these environments? Possibly from google drive? I spent some time at it and the example loading techniques all run into download limits or IO fails. Anybody successful at loading large data files?
  - kbumsik 9y ago
    There are many ways : 1. Upload local files directly (Doesn't work on Firefox) 2. HTTP download 3. Google Drive, Google sheets, Google Cloud Storage.. Take a look at this for more info: https://colab.research.google.com/notebook#fileId=/v2/external/notebooks/io.ipynb&scrollTo=vz-jH8T_Uk2c https://colab.research.google.com/notebook#fileId=/v2/extern...
chickenthief 9y ago
how can they make it free? Would this not be anti-competitive to smaller companies charging money for it?
- minimaxir 9y ago
  At current prices, the VM + GPU is $0.57/hr, which doesn’t break Google’s bank and is absurdly cheap for usability testing for a new product.
  - jo909 9y ago
    And the preemtible price is only $0.22 per GPU. Not that the GPUs used here seem to be preemtible, but this might give some hint to the baseline cost.
- Robadob 9y ago
  It's previous gen hardware, so presumably the only cost to google is energy usage and similar. They probably use the newer p100 and v100 cards internally which are significantly faster for deep learning.
  - chickenthief 9y ago
    It does not seem worthless: https://www.amazon.com/Nvidia-Tesla-GDDR5-Cores-Graphic/dp/B00Q7O7PQA https://www.amazon.com/Nvidia-Tesla-GDDR5-Cores-Graphic/dp/B... . It must have some depreciation cost.
  - puzzle 9y ago
    Not only that, the hardware is already on, so it's only a matter of the cost difference between an idle GPU and a busy one. It's not inconceivable that if enough paying customers showed up with K80 workloads, these freebie users might have to wait longer.
- puzzle 9y ago
  Presumably, there's not an unlimited number of them.
deleted 9y ago
[deleted]
ct520 9y ago
Deepfakes?
drewbuschhorn 9y ago
It's also nice that you can pip install basically any library, I guess, from within the notebook itself. I just copy and pasted a keras MNIST demo and it seemed to work like a charm. https://colab.research.google.com/notebook#fileId=1tD_viugd-ItB_W-bOfDfjGkfYQWZ_e5l https://colab.research.google.com/notebook#fileId=1tD_viugd-... (think you need a google account, fwiw)
bitL 9y ago
Is it possible to start a training run, logout for a month-two and return back once training is complete? Or does it only allow a single browser session?
- drewbuschhorn 9y ago
  1 hour timeout on runs. I'm assuming that means from one command execution to another, not per batch but shrug. Once it times out it looks like they save state and you can reconnect but I've not checked very closely. Same for saved data but I assume there's some way to chuck it into drive which is the storage backend as far as I can tell.

92 points by williamtrask 9y ago

This Free Nvidia GPUs that you mention... is that what Colaboratory is?

Providing a tl;dr: Google provides a jupyter / ipython research environment with some amount of integration to their existing services. This environment they call "Colaboratory". They have now started providing free access to GPU resources from within this environment. Details for using with tensorflow here: https://colab.research.google.com/notebook#fileId=/v2/external/notebooks/gpu.ipynb https://colab.research.google.com/notebook#fileId=/v2/extern...

joe_the_user 9y ago
Some bad headlines are worse the other bad headlines. And this one is fake-promising free candy of a brand I want.
forestgreen 9y ago
Anybody know how to upload large data files into these environments? Possibly from google drive? I spent some time at it and the example loading techniques all run into download limits or IO fails. Anybody successful at loading large data files?
- kbumsik 9y ago
  There are many ways : 1. Upload local files directly (Doesn't work on Firefox) 2. HTTP download 3. Google Drive, Google sheets, Google Cloud Storage.. Take a look at this for more info: https://colab.research.google.com/notebook#fileId=/v2/external/notebooks/io.ipynb&scrollTo=vz-jH8T_Uk2c https://colab.research.google.com/notebook#fileId=/v2/extern...

chickenthief 9y ago

how can they make it free? Would this not be anti-competitive to smaller companies charging money for it?

minimaxir 9y ago
At current prices, the VM + GPU is $0.57/hr, which doesn’t break Google’s bank and is absurdly cheap for usability testing for a new product.
- jo909 9y ago
  And the preemtible price is only $0.22 per GPU. Not that the GPUs used here seem to be preemtible, but this might give some hint to the baseline cost.
Robadob 9y ago
It's previous gen hardware, so presumably the only cost to google is energy usage and similar. They probably use the newer p100 and v100 cards internally which are significantly faster for deep learning.
- chickenthief 9y ago
  It does not seem worthless: https://www.amazon.com/Nvidia-Tesla-GDDR5-Cores-Graphic/dp/B00Q7O7PQA https://www.amazon.com/Nvidia-Tesla-GDDR5-Cores-Graphic/dp/B... . It must have some depreciation cost.
- puzzle 9y ago
  Not only that, the hardware is already on, so it's only a matter of the cost difference between an idle GPU and a busy one. It's not inconceivable that if enough paying customers showed up with K80 workloads, these freebie users might have to wait longer.
puzzle 9y ago
Presumably, there's not an unlimited number of them.

deleted 9y ago

[deleted]

ct520 9y ago

Deepfakes?

drewbuschhorn 9y ago

It's also nice that you can pip install basically any library, I guess, from within the notebook itself. I just copy and pasted a keras MNIST demo and it seemed to work like a charm. https://colab.research.google.com/notebook#fileId=1tD_viugd-ItB_W-bOfDfjGkfYQWZ_e5l https://colab.research.google.com/notebook#fileId=1tD_viugd-... (think you need a google account, fwiw)

bitL 9y ago

Is it possible to start a training run, logout for a month-two and return back once training is complete? Or does it only allow a single browser session?

drewbuschhorn 9y ago
1 hour timeout on runs. I'm assuming that means from one command execution to another, not per batch but shrug. Once it times out it looks like they save state and you can reconnect but I've not checked very closely. Same for saved data but I assume there's some way to chuck it into drive which is the storage backend as far as I can tell.