3 ms·
It should be noted that explicit hardware for deep learning is only worth it if you're training with high uptime (or are using the hardware for other things, e.
by minimaxir 8y ago
It should be noted that explicit hardware for deep learning is only worth it if you're training with high uptime (or are using the hardware for other things, e.g. gaming).
If you're a hobbyist training a model on a small dataset, the current prices of using cloud computing and running a GPU-backed VM for a couple hours on demand will still be cheaper in the long run.
- sgillen 8y agoAlso if your a student you might have access to a cluster free of charge. I’m shocked how many of my cohort have no idea they could be training with 4x v100s for free.
- grandmczeb 8y agoAs a non-ML grad student trying to do ML, where is this available from?
- sgillen 8y agoJust try googling around to see if your University has a HPC center. At my school the cluster isn't even geared towards ML but they happen to have super beefy nodes that are great for it.
- PinkMilkshake 8y agoI can speak for Australia only. Some options include: * University run HPC facilities. * Your university might have a deal with government funded facilities like the NCI (National Computational Infrastructure). Their computer Raijin has GPU's. * Or, they might be a participating University in AARNET (Australian Academic and Research Network), which next year will have web-based Jupyter Notebooks for smaller stuff. * I 100% guarantee there are multiple unused snowflake GPU clusters sitting under academics (with more money and influence than sense) desks that were purchased under the auspice of being "absolutely essential for their work" or "its the end of the year and we HAVE to spend this money" and because hey ignored all advice from IT it never works and is unsupported. Find them, be the support guy (if you have time) on the condition you get access.
- WrtCdEvrydy 8y agoThere's a free jupyter notebook also provided by Google if you just want to dick around.
- samblr 8y ago.. watched your textgenrnn youtube video a few minutes and I see your comment here :)
- minimaxir 8y agoSince you brought that video up: Google Colaboratory allows for a free K80 GPU; not as a strong as a GTX 1080/2080 mentioned in this article, but good enough to prototype things, as it's normally ~$0.57/hr on GCP. (how textgenrnn uses the free Colaboratory notebook: https://minimaxir.com/2018/05/text-neural-networks/ https://minimaxir.com/2018/05/text-neural-networks/) In the case of textgenrnn, I use the Colaboratory notebook exclusively nowadays. :P