8 ms·
When there's a gold rush, sell the pick axes and dynamite.
by justinator 3y ago
When there's a gold rush, sell the pick axes and dynamite.
- AlexandrB 3y agoNvidia has been the pick axe vendor for 2 gold rushes in a row now. First crypto, then AI. It's an extremely nice position to be in. Regardless of how something like OpenAI shakes out, Nvidia will keep making money.
- crazygringo 3y agoSeriously. I can't think of any other company that has managed to "luck out" this much. GPU's were designed for graphics. But then they just happened to be the right tool for crypto, and then the right foundation for ML. I can't think of any other company that has managed to benefit so much from a product designed for one thing, that turned out to be the solution to other things as well. (Edit: obviously they've done a ton of work to capitalize on these two trends and plan for them as they saw them coming, but that was always leveraging their pre-existing massive investment in GPU design and expertise.)
- deelowe 3y agoLuck is the combination of preparation and opportunity. Cuda has played a huge role in Nvidia's ML success. They were working on this for years before the AI wave took off.
- PartiallyTyped 3y agoThis is a very uninformed comment. As much as I hate praising big corp, NVDA played the game right. They saw the value of GPGPUs and invested heavily in CUDA, sponsored universities and research labs when the DL boom happened, helped all ML frameworks into incorporating CUDA (dl or otherwise), has done a lot of work on cudNN, sparsity, and has published countless papers. It didn't simply "turn out", and claiming such is doing a disservice to all the people who made that reality. Intel could have very well built accelerators and GPUs, but they didn't. AMD also didn't even though they had a GPU division as well.
- manquer 3y agoHardly , this is not about nvidia doing the foundation to make their own luck . It is about those industries taking off in a big way. Nvidia has zero contribution towards tranformers which was the driver behind the rise of AI or towards all the money that flowed in crypto during the low interest era. The point has all to do with how they have been part of two cycles of boom unrelated to their product. They are not AWS to have driven the cycle by their product itself , they have only capitalized on it with their good work .
- dotnet00 3y agoI recall that all the way back during the early days of their GPUs they were already talking about their compute capabilities, so I rather than luck, it's really just a lot of foresight, with crypto and AI emerging because of GPUs becoming good enough for the task, rather than happening to fit the problem.
- lsy 3y agoI don't think it's exactly "luck", the trends are being driven by the technology, which they have done a good job of inventing. For better or worse, low-watt parallel compute is the primary area of innovation in compute hardware, so naturally the areas of innovation in software are more likely to leverage this innovative hardware. In other words, when all you have is a ton of tiny processors, every problem looks like a massively parallel process. It does raise the question of what we are missing because we don't have e.g. super-fast single-threaded processors or whatever new tech exists in an alternate universe.
- deleted 3y ago[deleted]
- throw0101c 3y ago> I can't think of any other company that has managed to benefit so much from a product designed for one thing, that turned out to be the solution to other things as well. CUDA was first released in 2007: * https://en.wikipedia.org/wiki/CUDA https://en.wikipedia.org/wiki/CUDA * https://developer.download.nvidia.com/compute/cuda/1.0/NVIDIA_CUDA_Programming_Guide_1.0.pdf https://developer.download.nvidia.com/compute/cuda/1.0/NVIDI... Two years before the Bitcoin paper (2009): * https://en.wikipedia.org/wiki/Bitcoin https://en.wikipedia.org/wiki/Bitcoin They had a presentation called "The Era of the Personal Supercomputing" at SIGGRAPH 2007: * https://dl.acm.org/doi/10.1145/1281500.1281647 https://dl.acm.org/doi/10.1145/1281500.1281647 * https://www.nvidia.com/content/events/siggraph_2007/supercomputing.html https://www.nvidia.com/content/events/siggraph_2007/supercom... Ian Buck (co-?)creator of CUDA speaking in 2008: > Ian Buck talks about his background developing Brook for GPUs at Stanford university and what paths were taken for developing a C platform for GPUs. * https://www.youtube.com/watch?v=Cmh1EHXjJsk https://www.youtube.com/watch?v=Cmh1EHXjJsk > In 2003, a team of researchers led by Ian Buck unveiled Brook, the first widely adopted programming model to extend C with data-parallel constructs. Ian Buck later joined NVIDIA and led the launch of CUDA in 2006, the world's first solution for general-computing on GPUs. * https://developer.nvidia.com/cuda-zone https://developer.nvidia.com/cuda-zone * http://graphics.stanford.edu/~ianbuck/ http://graphics.stanford.edu/~ianbuck/ Nvidia purposefully went after parallel computing. Specific applications (cryptocurrency, ML/AI) appeared later.
- EduardoBautista 3y agoA strong argument can be made that Nvidia helped these technologies gain traction.
- PaulHoule 3y agoIn the early 2000s it was a common theme in the CS literature that the Von Newman architecture was about to run out of steam and some kind of parallel processor was going to become mainstream, out of all that work the GPGPU became the most famous. If NVIDIA hadn’t done it, someone else would have.
- 3seashells 3y agoWell, parallelization was to be the stairway to heaven from Moores plateau..
- redkoala 3y agoA different lens is that GPUs are designed for parallel computing, of which graphics is the first primary use case. Crypto and AI/ML are perfect suits for parallel computing, and not the last ones. And nvidia is in the perfect spot there for the future of parallel computing as a whole.
- dgellow 3y agoThey didn’t luck out, they developed CUDA for decades at this point
- cactusplant7374 3y agoIf OpenAI doesn’t achieve AGI, which it won’t, demand probably won’t continue to grow. LLM’s will find their limit and massive training budgets won’t be needed. Since I'm being rate limited for one downvote: > All science is brute force of guess and test, and OpenAI does a lot of that. Nope. Science looks to answer a critical question. It doesn't conduct trillions of experiments at one time. > You don't think there's any possibility of emergent properties? Given that we understand physically how the human brain works, but not how consciousness emerges from that, I'm pretty damn unconfident. Possibility? Why? Because Altman & co are hyping things up? They have no proof of a breakthrough. It's just posturing.
- LanceJones 3y agoAlways interesting to see the hubris of certainty. You don't want to use ANY qualifiers?
- cactusplant7374 3y agoIf you accuse me of hubris, are you willing to take a $10,000 bet? It's clear that there is no science happening at OpenAI. It's pure brute force. You won't learn anything with that approach.
- freedomben 3y agoYou don't think there's any possibility of emergent properties? Given that we understand physically how the human brain works, but not how consciousness emerges from that, I'm pretty damn unconfident.
- rational_indian 3y agoLOL.
- anon291 3y ago> It's pure brute force. All science is brute force of guess and test, and OpenAI does a lot of that.
- TradingPlaces 3y agoNothing like being lucky and good.
- nightski 3y agoThis completely ignores the cash cow that is gaming, which has made them far more money than crypto ever did. AI is a little different for now, we'll see how it holds up.
- PaulHoule 3y agoThat article says that gaming cash has been eclipsed by A.I. in the short term but you could say the gaming market is more of a sure thing in the long term.
- moogly 3y agoNot at these GPU prices. Over time, that might force people away from PC gaming, and Nvidia is not powering high-end consoles.
- 8f2ab37a-ed6c 3y agoGeForce Now is really solid though, I've already moved most of my gaming to that. They could ride that wave as well.
- PaulHoule 3y agoIt could let them push for higher gfx card pricing since the cards would have a higher duty cycle and deliver more value in a cloud environment but unfortunately I am in the wrong side of a DSL connection. I am disappointed that nobody in cloud gaming has made a game that using the monsterous GPU instances in the cloud to synthesize a super-complex world and generate video for multiple players simultaneously but I think a system like that would not really beat highly optimized single players and furthermore optimizing it to the point where they could really deliver a “skip three generations” kind of experience would be expensive and risky.
- nightski 3y agoI don't think ML is driving consumer GPU prices, although I could be wrong. They are selling 3080s and below primarily for gaming. Maybe an argument could be made for the 3090/4090, but even then that is extreme solo enthusiast territory. It's clearly the higher end chips that are bringing in the AI revenue.
- notyofriend 3y agoThat’s a great business model, selling pickaxes and dynamite on credit though can backfire if your are the one loaning out the money. Nvidia is a bit at risk it this gold rush ends suddenly
- beembeem 3y agowe saw that with crypto and they took a hit for a quarter or so and moved on
- notyofriend 3y agoThey didn’t lend out money to the crypto industry last time
- deleted 3y ago[deleted]