12 ms·
What does this have to do with https://gpu.land/ https://gpu.land/ ? I've been very impressed with NN-512 in your past postings but I'm failing to see the direc
by rckoepke 6y ago
What does this have to do with https://gpu.land/ https://gpu.land/ ? I've been very impressed with NN-512 in your past postings but I'm failing to see the direct salience w.r.t the top level post.
Perhaps readers would benefit from an apples-to-apples comparison of V100 to some CPU in a training per dollar metric? Preferably using something like MLPerf. You do mention inference but I think most people looking at https://gpu.land/ https://gpu.land/ will be far more interested in training rather than inference.
I think the most direct competitor to this ShowHN would be https://vast.ai/ https://vast.ai/
- ilmoi 6y agoYou are correct that vast.ai is pretty close. The biggest difference is probably security / guaranteed uptime. With vast you're getting what it says on the tin - a machine from a marketplace. Could come from anyone / anywhere. No idea what else is running on it. Ours are hosted in a professional DC, managed and secured as they should be. If anyone's curious, there's a detailed comparison page with other platforms here - https://gpu.land/versus https://gpu.land/versus
- perennate 6y agoI think Linode/Paperspace/AWS/GCP/etc. are closer to "direct competitors". I would be much more comfortable trusting a single entity that owns its servers than a GPU rental marketplace like vast.ai.
- 37ef_ced3 6y agoThe suggestion is that you may not want to use a GPU if you can use AVX-512 CPUs for your machine learning workload. Reducing the cost of the GPU helps, but it's still relatively expensive
- sharemywin 6y agoHere's an article about ROBLOX running BERT on cpus versus GPUs. https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/ https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-... They're not training so I think that's the difference.