8 ms·
Can someone explain the technology edge Nvidia has? AMD, Intel etc. have not been able to compute in high-performance GPU market, so Nvidia must have an edge
by nabla9 9y ago
Can someone explain the technology edge Nvidia has?
AMD, Intel etc. have not been able to compute in high-performance GPU market, so Nvidia must have an edge. How big and sustainable it is?
- dogma1138 9y agoThey understood really early on that you need to invest in software just as much as you would need to invest in hardware if not more. Open standards tend to be a horse designed by a committee, it can take years for them to evolve and to reach any consensus and they would never be able to match the speed in which hardware can evolve and adapt to market requirements. So NVIDIA essentially made their own software ecosystem which can be just as flexible as their hardware and more importantly it allows NVIDIA to be proactive rather than reactive.
- ethbro 9y agoThey also realized non-CS researchers don't have the time, expertise, budget, or interest in writing optimized ML libraries. And that if a graphics card company wrote easier to use / higher stack libaries, this would be a competitive advantage.
- deleted 9y ago[deleted]
- shmerl 9y agoThey don't really have an edge today. They just achieved big lock-in, and inertia of those who depend on CUDA now prevents them from using other hardware.
- ggg9990 9y agoWhat prevents other vendors from making CUDA compliant hardware? I thought the result of Oracle v. Google is that APIs can’t be copyrighted?
- wtallis 9y ago> I thought the result of Oracle v. Google is that APIs can’t be copyrighted? The result—not final yet—is that the Federal Circuit ruled APIs are eligible for copyright, but that ruling didn't create binding precedent that applies outside the Oracle v Google case. So future cases are still likely to produce the result that APIs can't be copyrighted, unless those cases also include the patent claims necessary to get them into the Federal Circuit for appeals.
- shmerl 9y agoEven if you assume APIs aren't copyrightable, I don't think anyone cared to implement CUDA itself except for Nvidia. There is really no point in proliferating such APIs, since there are OpenCL / Vulkan already which are open to begin with. What someone could try implementing though, is translating CUDA into OpenCL (if that's possible). That would be useful to break lock-in.
- llukas 9y agoYou can implement your own cuda no problem: https://research.google.com/pubs/pub45226.html https://research.google.com/pubs/pub45226.html or write your own assembly https://github.com/NervanaSystems/maxas https://github.com/NervanaSystems/maxas What you miss is there is a reason why OpenCL didn't get traction and lack of tools translating CUDA to OpenCL is not one of them. OpenCL 2.0+ is lot better than previous versions but it is too little to late.
- shmerl 9y ago> lack of tools translating CUDA to OpenCL is not one of them. And why not? If you can translate between them, it will help supporting legacy CUDA software. And new one can use new OpenCL to begin with.
- llukas 9y agoLegacy CUDA software would exist if OpenCL ecosystem was better. This is not the case. Code translation from CUDA to OpenCL is solution looking for a problem.
- shaklee3 9y agoHow can you say that? Have you compared their cards to AMD or Intel? It's not even a fair comparison.
- make3 9y agoin deep learning, they presented high quality hand optimized building blocks way before anybody else did (CuDNN). An effect of that is that the libraries were built around cuda and cudnn, and now amd is still trying to catch up. Intel just hasn't delivered a fast enough, flexible enough, cheap enough gpu or gpu alternative afaik
- jamesblonde 9y agoTo repeat the other comments, right now CuDNN is the advantage - that is manifested as TensorFlow/Keras/PyTorch. AMD have RocM and in these benchmarks it was like 10X or more slower training for CNNs that P100s - https://www.pcper.com/reviews/Graphics-Cards/NVIDIA-TITAN-V-Review-Part-3-Deep-Learning-Performance https://www.pcper.com/reviews/Graphics-Cards/NVIDIA-TITAN-V-... How sustainable is the advantage? Not that big - you don't need cuda compatability like hiptensorflow tried in a classic shortcuts-dont-work way. Just an alternative CuDNN for Vega that is integrated in TensorFlow distributed binaries.
- nabla9 9y agoIn other words Nvidia has no meaningful edge in hardware microarchitecture, patents and innovation. Is this correct? If you remove the software and compare the raw cost/flops/bandwidth/memory/energy to others the difference is small?
- jamesblonde 9y agoYeah, pretty much. They are claiming the future is specialization in compute. Tensorcores are an attempt at this - they should more accurately be called "4x4 matrix multiply in half precision with a full-precision add". That is the instruction they support. Unless you are training a very deep CNN with a lot of 4x4 kernels, they won't give you much of a speedup. You're left then with the memory-GPU b/w. For the 1080Ti, that's 484GB/s and it's about 950GB/s for the V100. So about twice the training performance for 10 times the price. Not a good deal, IMO. When you compare that with the top Vega cards, it's a complete rip-off - but Vega cards are currently useless for deep learning. I'm not convinced AMD have put the money in to build the libraries, so we're stuck with AMD for a while yet (unless Intel by some miracle pull one out with its new platform).
- nightski 9y agoWhat about NVLink? I'm pretty sure there is no equivalent for AMD right? That would be a pretty big deal.
- pjmlp 9y agoThey were clever to understand that developers wanted the freedom to code GPGPU in C, C++, Fortran plus any other language able to target their bytecode (PTX) instead of being bound programming in crufty C. Then they created nice numeric libraries and graphical debuggers for GPU programming. Their new Volta GPUs were explicitly designed to be developed in C++ (there are a few talks about it). When Khronos woke up for the idea that maybe they should support something else other than C, invoking compilers and linkers during runtime, with OpenCL 2.0, already most developers were deeply invested into CUDA.
- liquidify 9y agoOne note on this. Their graphical debuggers aren't user friendly at all. And the Eclipse platform "Nsight" is a pile of garbage. I haven't used the version in visual studio, but if it isn't way way better, then people might as well stick to vim and cuda-GDB... or just put printf statements everywhere like most of us do. The really need to develop a purpose built IDE or work on their integration way more.
- Nokinside 9y agoI think people are underestimating the difficulty of developing high performance microarchitecture for GPU or CPU. A new clean sheet design architecture takes 5-7 years even for teams that have been doing it constantly for decades in places like Intel, AMD, ARM or Nvidia. This includes optimizing the design into process technology, yield, etc. Then there is economies of scale and price points. Recent examples: * Nvidia's Volta microarchitecture design started 2013, launch was December 2017 * AMD's zen CPU architecture design started 2012 and CPU was out 2017.
- ksec 9y agoI think Microarchitecture design in CPU is order of magnitudes harder then GPU.