3 ms·
Yes, NVIDIA owns Deep Learning. And they will continue to own it for at least the next 2 years. But I would be remiss not to point out that you can build one
by varelse 11y ago
Yes, NVIDIA owns Deep Learning. And they will continue to own it for at least the next 2 years. But I would be remiss not to point out that you can build one of these things yourself for less than half the price at which they're selling it.
And while I think one can build a deep learning ASIC, a 10x better ASIC seems like a tough bet to me. I mean on the surface it sounds good, but the devil is in the details here and by the time you've built something flexible enough to run every reasonable variant of a neural network both forwards and backwards, you start making the sort of decisions that make your processor look more and more like a GPU and that magical perf delta drops. Also if you start today, you need to target tomorrow's GPUs, not the $1000 consumer model you can buy on Amazon now.
That said, I'm looking forward to Altera's new hardcoded floating point-enhanced FPGAs. Too bad I have no idea how much they cost.
- dharma1 11y agoEven less if you use AMD GPU's -https://www.reddit.com/r/linux/comments/2zgpj8/15000_nvidia_developer_system/cpjjff5 https://www.reddit.com/r/linux/comments/2zgpj8/15000_nvidia_... I wonder why the popular deep learning frameworks are using mainly CUDA instead of OpenCL. Is because of better Linux GPU drivers? Wondering why AMD isn't jumping on deep learning The Altera FP capable FPGA's sound real interesting too. 10 TFLOPS, OpenCL support? http://www.slideshare.net/embeddedvision/a04-altera-singh http://www.slideshare.net/embeddedvision/a04-altera-singh Looks like they're about to be bought by Intel? http://www.electronicsweekly.com/news/business/altera-important-intel-2015-06/ http://www.electronicsweekly.com/news/business/altera-import... Does this mean FPGA co-processors in the future from Intel?
- varelse 11y agoI would love to see AMD jump in the ring, and there's even an OpenCL port of Caffe in progress: https://github.com/BVLC/caffe/pull/2610 https://github.com/BVLC/caffe/pull/2610 But its performance is less than half that of a GTX 980 running CUDA. Still, AMD is silly not to try and improve on this IMO.
- dharma1 11y agoWonder what's causing the perf drop. Would make sense to Intel to push openCL for deep learning too
- varelse 11y agoBad compilers would be my guess. And not only would it make sense for Intel to push OpenCL for Deep Learning, but it would make sense (IMO of course) for them to push OpenCL as a much better abstraction for accessing the vector units in all their CPUs in a multicore fashion across the board.
- p1esk 11y ago"Altera's new hardcoded floating point-enhanced FPGAs. Too bad I have no idea how much they cost." Probably in the same ballpark as current high end Altera chips: over $30k. If you need a thousand of them for your datacenter, think about what kind of ASIC you could design for $30 millions. Or think about how many Titan X cards you can buy for $30k :)