10 ms·
Seriously. I can't think of any other company that has managed to "luck out" this much. GPU's were designed for graphics. But then they just happened to be the
by crazygringo 3y ago
Seriously. I can't think of any other company that has managed to "luck out" this much.
GPU's were designed for graphics. But then they just happened to be the right tool for crypto, and then the right foundation for ML.
I can't think of any other company that has managed to benefit so much from a product designed for one thing, that turned out to be the solution to other things as well.
(Edit: obviously they've done a ton of work to capitalize on these two trends and plan for them as they saw them coming, but that was always leveraging their pre-existing massive investment in GPU design and expertise.)
- deelowe 3y agoLuck is the combination of preparation and opportunity. Cuda has played a huge role in Nvidia's ML success. They were working on this for years before the AI wave took off.
- PartiallyTyped 3y agoThis is a very uninformed comment. As much as I hate praising big corp, NVDA played the game right. They saw the value of GPGPUs and invested heavily in CUDA, sponsored universities and research labs when the DL boom happened, helped all ML frameworks into incorporating CUDA (dl or otherwise), has done a lot of work on cudNN, sparsity, and has published countless papers. It didn't simply "turn out", and claiming such is doing a disservice to all the people who made that reality. Intel could have very well built accelerators and GPUs, but they didn't. AMD also didn't even though they had a GPU division as well.
- manquer 3y agoHardly , this is not about nvidia doing the foundation to make their own luck . It is about those industries taking off in a big way. Nvidia has zero contribution towards tranformers which was the driver behind the rise of AI or towards all the money that flowed in crypto during the low interest era. The point has all to do with how they have been part of two cycles of boom unrelated to their product. They are not AWS to have driven the cycle by their product itself , they have only capitalized on it with their good work .
- dotnet00 3y agoI recall that all the way back during the early days of their GPUs they were already talking about their compute capabilities, so I rather than luck, it's really just a lot of foresight, with crypto and AI emerging because of GPUs becoming good enough for the task, rather than happening to fit the problem.
- lsy 3y agoI don't think it's exactly "luck", the trends are being driven by the technology, which they have done a good job of inventing. For better or worse, low-watt parallel compute is the primary area of innovation in compute hardware, so naturally the areas of innovation in software are more likely to leverage this innovative hardware. In other words, when all you have is a ton of tiny processors, every problem looks like a massively parallel process. It does raise the question of what we are missing because we don't have e.g. super-fast single-threaded processors or whatever new tech exists in an alternate universe.
- deleted 3y ago[deleted]
- throw0101c 3y ago> I can't think of any other company that has managed to benefit so much from a product designed for one thing, that turned out to be the solution to other things as well. CUDA was first released in 2007: * https://en.wikipedia.org/wiki/CUDA https://en.wikipedia.org/wiki/CUDA * https://developer.download.nvidia.com/compute/cuda/1.0/NVIDIA_CUDA_Programming_Guide_1.0.pdf https://developer.download.nvidia.com/compute/cuda/1.0/NVIDI... Two years before the Bitcoin paper (2009): * https://en.wikipedia.org/wiki/Bitcoin https://en.wikipedia.org/wiki/Bitcoin They had a presentation called "The Era of the Personal Supercomputing" at SIGGRAPH 2007: * https://dl.acm.org/doi/10.1145/1281500.1281647 https://dl.acm.org/doi/10.1145/1281500.1281647 * https://www.nvidia.com/content/events/siggraph_2007/supercomputing.html https://www.nvidia.com/content/events/siggraph_2007/supercom... Ian Buck (co-?)creator of CUDA speaking in 2008: > Ian Buck talks about his background developing Brook for GPUs at Stanford university and what paths were taken for developing a C platform for GPUs. * https://www.youtube.com/watch?v=Cmh1EHXjJsk https://www.youtube.com/watch?v=Cmh1EHXjJsk > In 2003, a team of researchers led by Ian Buck unveiled Brook, the first widely adopted programming model to extend C with data-parallel constructs. Ian Buck later joined NVIDIA and led the launch of CUDA in 2006, the world's first solution for general-computing on GPUs. * https://developer.nvidia.com/cuda-zone https://developer.nvidia.com/cuda-zone * http://graphics.stanford.edu/~ianbuck/ http://graphics.stanford.edu/~ianbuck/ Nvidia purposefully went after parallel computing. Specific applications (cryptocurrency, ML/AI) appeared later.
- EduardoBautista 3y agoA strong argument can be made that Nvidia helped these technologies gain traction.
- PaulHoule 3y agoIn the early 2000s it was a common theme in the CS literature that the Von Newman architecture was about to run out of steam and some kind of parallel processor was going to become mainstream, out of all that work the GPGPU became the most famous. If NVIDIA hadn’t done it, someone else would have.
- 3seashells 3y agoWell, parallelization was to be the stairway to heaven from Moores plateau..
- redkoala 3y agoA different lens is that GPUs are designed for parallel computing, of which graphics is the first primary use case. Crypto and AI/ML are perfect suits for parallel computing, and not the last ones. And nvidia is in the perfect spot there for the future of parallel computing as a whole.
- dgellow 3y agoThey didn’t luck out, they developed CUDA for decades at this point