7 ms·
Intel Shipping Nervana Neural Network Processor First Silicon Before Year End
- kbumsik 9y agoI hope Intel would try to integrate this with existing ML libraries like Tensorflow and Caffe, rather than to make their own separated ecosystems.
- andy_ppp 9y agoHaha, I would be shocked if they don’t reinvent the wheel, but let’s hope they don’t.
- alvern 9y agoI'm betting it shares a lot with the Movidius Neural Compute Stick and uses Caffe for the ML. https://developer.movidius.com/ https://developer.movidius.com/
- nrp 9y agoNervana and Movidius were separate acquisitions by Intel and were relatively recent. I’d be surprised if they managed to merge the software efforts that quickly.
- novaRom 9y agoUnfortunately for Intel, it is probably too late. The specs of new processors are not impressing even in comparison with previous Tesla generation.
- adventured 9y agoWell, first they're Intel. Second, they have $25 billion in cash and $10b per year in profit. They have the resources to be persistent if it's important. This is still the first inning. It'd be like calling it too late in 3D graphics chips when 3dfx shipped the Voodoo. It's nowhere near too late, the market will be a decade in the making.
- samstave 9y agoHaha great fucking example. Nvidia swallowed a market that was supposedly a closed case with the voodoo... Btw, how is AMD doing these days?
- doomlaser 9y agoYou could have said the same thing about Microsoft's late entry into the touchscreen smartphone market.
- adventured 9y agoYou could have said the same thing about X Y Z. Some of those turn out correctly, some of those turn out wrong. It's nearly meaningless as a generalized premise. Nintendo's NES arrived into the global video game console market long after Atari. Sony was very far behind in arriving into the console market with the first PlayStation. Google arrived years after Excite and AltaVista. The portable mp3 player market was years old when the iPod arrived. Microsoft was years behind in most cases in productivity software. It almost always chased from behind, that includes with Windows. In the early years Dell was tiny in terms of volume compared to the computer majors at the time. How could they possibly catch up? AMD was practically bankrupt on multiple occasions. They lost a billion dollars in 2014+2015. What chance did they have in coming back to life and challenging Intel again, having to chase from behind like they have? The tech industry is overflowing with examples throughout its history of companies entering existing markets and taking them, or otherwise recovering from running behind.
- doomlaser 9y agoNone of those were examples of companies buying their way into markets late with me-too strategies financed by dominant war chests.
- santoshalper 9y agoIt just depends on how good the "me too" is. When the competition is a repurposed videogame accelerator, it's not hard to believe a dedicated, built for purpose device could be better.
- modeless 9y agoWhat specs? You have specs for this chip? AFAIK no benchmarks have been disclosed.
- omarforgotpwd 9y ago“Alright guys we already blew it on mobile. People are starting to realize that they can put ARM in their data center and save a ton on electricity. We better not blow it on this AI thing with Nvidia”
- mtgx 9y agoI think they already did? Highly unlikely this chip is ahead of Volta. And Nvidia has already teased much higher performance than Volta with its next-generation, at least for inference (320 TOPS at 30W).
- omarforgotpwd 9y agoYes, they pretty much already blew it.
- scottlegrand2 9y agoNot that I want to give Intel any credit here whatsoever because they don't deserve any, but that 320 Tera Ops number involves multiple chips and to the best of my knowledge, Nvidia has not specified whether that's 8, 16, or 32 bit math. And they're not the only ones, we still don't know the underlying math model in Google's second generation TPU now do we? We are swimming in a sea of FUD and Benchmarksmanship right now, but if I had to make a bet, the next three years are owned by Nvidia. After that, things get hazy.
- deleted 9y ago[deleted]
- dragontamer 9y agoWhat's the key advantage of this Nervana architecture over GPUs? I can theorycraft... hypothetically, GPUs have a memory architecture structured like this: (using OpenCL terms here) Global Memory <-> Local <-> Private Memory, correlating to the GPU <-> Work Group <-> Work Item. On AMD's systems, "Local" and/or Work Group tier is a group of roughly 256-work items (or in CUDA Terms, a 256-"Block" of "Threads") and all 256-work items can access Local Memory at outstanding speeds (and then there's even faster "Private" memory per work item / thread, which is basically a hardware register). On say a Vega 64, there are 64-compute units (each of which has 256 work items running in parallel). The typical way Compute Unit 1 can talk to Compute Unit 2 is to write data from CU1 into Global Memory (which is off-chip), and then read it back in in CU2. In effect, GPUs are designed for high-bandwidth communications WITHIN a Workgroup (or "Warp" in CUDA terms), but they have slow communications ACROSS Work-groups / Warps. In effect, there's only "one" Global Memory on a GPU. And in the case of a Vega64 GPU, that's 16384 work items that might be trying to hit Global Memory at the same time. True, there's caching layers and other optimizations, but any methodology based on Global resources will naturally slow down code and hamper parallelism. Neural Networks possibly can have faster memory message passing if there were a different architecture. Imagine if the compute-units allowed quick communication in a torus for example. So compute unit #1 can quickly communicate to compute unit #2. This would roughly correlate to "Layer1 Neurons" passing signals to "Layer2 Neurons" and vice versa (say for backpropagation of errors). Alas, I don't see much information on what Nervana is doing differently. When "Parallela" came out a few years ago, they were crystal clear on how their memory architecture was grossly different than a GPU... it'd be nice if Nervana's marketing material was similarly clear. ---------- Hmm, this page is a bit more technical: https://www.intelnervana.com/intel-nervana-neural-network-processors-nnp-redefine-ai-silicon/ https://www.intelnervana.com/intel-nervana-neural-network-pr... It seems like the big selling points are: * "Flexpoint" -- They're a bit light on the details, but they argue that "Flexpoint" is better than Floating Point. It'd be nice if they were a bit more transparent on what "Flexpoint" is, but I'll imagine that its like a Logarithmic Number System (https://en.wikipedia.org/wiki/Logarithmic_number_system https://en.wikipedia.org/wiki/Logarithmic_number_system) or similar, which probably would be better for low-precision Neural Network computations. * "Better Memory Architecture" -- I can't find any details on why their memory architecture is better. They just sorta... claim its better. Ultimately, GPUs were designed for graphics problems. So I'm sure there's a better architecture out there for Neural Network problems. Its just fundamentally a different kind of parallelism. (Image processing / shaders handling the top-left corner of a polygon don't need to know what's going on on the bottom-right polygon. So GPUs don't have high-bandwidth communication lines between those units. Neural Networks require a little bit more communication than image processing problems did from the past). But I'm not really seeing "why" this architecture is better yet.
- vonnik 9y agoIntel has been saying all along that they would ship Nervana's chips by year end, so not really news. The news will be if they miss their deadline.