6 ms·
So.. speaking as someone who does some deep learning (but quite a bit of ML more broadly). Intel are correct that the memory size on GPUs is increasingly becom
by nl 10y ago
So.. speaking as someone who does some deep learning (but quite a bit of ML more broadly).
Intel are correct that the memory size on GPUs is increasingly becoming a problem in some complex deep learning models. Having access to cheap(ish) DDR4 RAM using the same programming model would be a big win.
Interestingly, AMD is going after a related market (visualization) which is also very RAM hungry by building GPUs with M.2 SSDs onboard[1]. AFAIK no one has tried these for deep learning.
But within the deep learning community there's a fair bit of cynicism about Intel's claims. Over the last few years they have frequently claimed parity with GPUs... any day now. Yet they keep falling further behind in any useful benchmark.
[1] http://www.anandtech.com/show/10518/amd-announces-radeon-pro-ssg-fiji-with-m2-ssds-onboard http://www.anandtech.com/show/10518/amd-announces-radeon-pro...
- conjectures 10y agoMore memory would indeed be a bid deal for ML applications. Found this comment useful as it's not clear to me whether the 'Knights Landing' will actually be comparable to GPU in terms of pure grunt. Then I wonder if Nvidia will respond with more memory on their cards. From my totally uninformed perpective, that would seem easier than the transition Intel are trying to go for.
- nl 10y agoThe programming model for GPUs isn't great - since they aren't general purpose platforms you have to keep thinking about moving data around between the GPU memory and the main memory. Intel could bypass that and end up with an easier programming model. But.. believe it when you see it. Note that this is almost entirely about deep learning though. Non DL machine learning is mostly done on CPUs at the moment (with a few exceptions) and generally performs adequately. More speed is always nice, but you don't hear a lot of complaints about XGBoost's speed, or FastText, or VopalWabbit, or the various FTL regression algorithms implemented on CPUs.
- deepnotderp 10y agoYes, but deep learning is clearly the future. I'd love to fully unroll my rnns.