8 ms·
Nvidia on the Mountaintop
- bhouston 3y agoI have to give it to NVIDIA, they are great at taking advantage of various industry trends and riding them. I see it over and over again: NVIDIA out in front on a new industry trend. It is the biggest constant of NVIDIA I've witnessed over the last 2 decades. Each of these trends inevitably comes to an end, but NVIDIA internally is clearly enabling itself for the next possible trends to take advantage of.
- jonas21 3y agoThe constant is that NVIDIA has been investing in CUDA for the last 2 decades, and has built up an enormous lead in terms of mindshare and existing CUDA code out there. Specific applications may vary over time, and it's NVIDIA's investment in GPGPU and CUDA that allows them to be a leader in each of these. But it's also worth noting that one of these, neural nets, have been big on NVIDIA hardware for a decade now, so it's not exactly a "trend".
- jjallen 3y agoArguably AI and machine learning IS a trend. Just because it is ten years old does not mean it isn't a trend. A trend is a consistent increase or decrease, with no limits on duration.
- capableweb 3y agoAI/ML is far older than a decade, more like 6 decades at this point. However, I agree that interest in it is also wildly going up and down, so maybe more correct is to say that the attention AI/ML receives is what's trending, rather than the area itself.
- bhouston 3y agoI was using NVIDIA before CUDA and they were always on trend even back then. First they had the fastest 3D GPUs, or at least the best advertised ones. Then they had the programmable shaders, and then NVIDIA Cg, a great GPU programming language, which was pre-HLSL/GLSL. Then they acquired AGIA, which brought them PhysX + CUDA. But even recently they have innovated with fast networking, tensor cores and RTX. They are a consistent innovation machine.
- airstrike 3y agoShorting NVDA today feels to me like shorting AMZN in the aughts. The secular tailwinds are simply too great to bet against. GPT-4 is only the beginning.
- bob1029 3y ago> The secular tailwinds are simply too great to bet against You can take up both positions if you want. I've got long exposure through various ETFs. I also maintain a small hedge in the form of put options. Overall, most of my NVDA money pile says "it would be fantastic if this all works out". But, I have a small % of the pile dedicated to "Just in case...". The only situation I don't want is one wherein things stay exactly at this level and don't move anywhere for a long time (or do so incredibly slowly). Would you bet against volatility in the AI/GPU market over the next 12 months?
- RussianCow 3y ago> Would you bet against volatility in the AI/GPU market over the next 12 months? The problem with betting on volatility (via options at least) is that it's already priced into the market, which means you pay a large premium for that bet, which in turn means that things need to make big moves for it to pay out. So it's not enough to be confident that there will be some movement in either direction—it has to be a relatively large movement for it to be profitable. So to answer your question, maybe. I don't think it's unreasonable to think that Nvidia stock won't drastically change over the next 12 months. Disclaimer: I'm long Nvidia because I'm willing to wait and see how high this ride goes.
- pclmulqdq 3y agoHFTs and hedge funds are profitable because stuff isn't actually priced in. Nvidia has a lot of historic volatility which makes the options expensive, but if you believe the fall will be as fast as the rise, put options rarely price that in.
- RussianCow 3y ago
- pr337h4m 3y ago>The question, though, is what will be the analogy to mobile (and the cloud), which exploded demand and led to one of the most profitable decades tech has ever seen? The answer may be an already discarded fad: the metaverse. People haven't really noticed that building a general-purpose (humanoid) robot has become 1000x more feasible now even compared to 1.5 years ago. Check out https://www.lerf.io/ https://www.lerf.io/ for a taste of the future
- eatporktoo 3y agoFor anyone with Firefox trying to open the link- it seems slow or broken in FF. Use Chrome and it loads instantly.
- deleted 3y ago[deleted]
- CameronNemo 3y agoNo thanks.
- martythemaniak 3y agoYep, there's a giant pile of training (and inference) that has yet to be done because we've barely touched real-world data (audio, visual and tactile). GPT-4 already demo'd a multimodal version, and I don't see a reason why GPT-N won't be able to seamlessly work on video and tactile input and output actuator commands. I also don't see a reason why humanoid bodies would cost more than a car. Maybe people don't realize how low the bar for mass-adoption is? We're kinda mesmerized by Boston Dynamics' Parkourbot, but the real-world is made for people of many different abilities, you don't need to do summersaults, or run, or lift a lot to be able to do useful work. A $30k robot with a lifespan of 8 years would cost $10/day. $10 is very little money for in-your-house work, being able to do basic cleanup will be worth it for a vast number of households.
- thunky 3y ago> Boston Dynamics' Parkourbot > you don't need to do summersaults, or run, or lift a lot to be able to do useful work I agree that it's a gimmick, but every time I see it I'm reminded of how far we are from having an in-home robot that can do useful work like wash the bed sheets and clean the toilet.
- pier25 3y ago> I have a hard time seeing what companies are going to go through the time and effort to port things that already run on CPUs to GPUs Maybe on the data center, but in the audio world this is already happening. https://www.gpu.audio/ https://www.gpu.audio/ VSL (a huge company in the audio/production world) added it recently to their convolution reverb product. https://www.gpu.audio/partners/vsl https://www.gpu.audio/partners/vsl https://www.youtube.com/watch?v=L3xcq_m3Llw https://www.youtube.com/watch?v=L3xcq_m3Llw
- aabhay 3y agoI think the key reason why the world will move a lot of stuff that “already exists on CPUs” to GPUs is not that we’re porting existing code, it’s that GPU acceleration is a meta-trend that is disrupting all highly technical fields. It started much earlier decades ago in gaming and video. It then moved to grid and scientific computing. It has now fully revolutionized AI. The returns on better CPU code are much less than the returns on GPU code in the medium term as many of these trends in graphics, scientific computing, AI are mutually reinforcing. When 90% of your pipeline runs of GPU then the last 10% might as well too. There are obviously tons of small things that require CPU but the most important and crucial systems code should be moved to massive parallel architectures.
- trostaft 3y agoCUDA being feature complete and having libraries & frameworks optimized and immediately deploy-able for it is all the difference. I don't like much of their business/marketing practices for their gaming GPU division, but their engineering and HPC teams are world class and have been awesome to work with / use as an someone who writes scientific computing code on the GPU.
- dubcanada 3y agoI'm all for the post, but are we really attempting to add logic to stock prices? The price of NVDA stock does not correlate with any sort of logical math, this plus this = stock price type of equation. Stock prices are entirely based on what people think they are worth.
- what_ever 3y agoWhat bs. And how do people think a stock is worth? There is no logic in that?
- slt2021 3y agomomentum investors (or hype investors, of which there are many) don't care about the current price, as long as chart is going up and to the right
- thunky 3y agoThere is some intrinsic value in a stock, but since it is based on future unknown values it's impossible to know or predict. So yes, that makes it possible for the price to become disconnected from any reasonable prediction.
- deleted 3y ago[deleted]
- slt2021 3y agothere is also a secondary market for options - where investors trade volatility, and use stock as instrument to trade volatility and express their view. if volatility is priced at a bargain, investors doesnt care much about the stock, as he will be hedging his delta exposure anyways by means of dynamic hedging/etc
- mfitton 3y agoDoes it not? Given their current profits, we would expect 25b in rolling year profits. Their market cap is 1.2t. Apple, with about 80b in rolling year, has a market cap of 2.8t Given the kind of revenue and profit growth forecast NVDA has given, these numbers don't seem terribly far off. Worth noting that NVDA's profits 8xed in a single year. A lot of people are basing their NVDA valuation based on the past year's revenue, which does make them look extremely overvalued. However, if NVDA has enough sales and enough of a moat to double their profits again, suddenly they'll be biting at Apple's heels profit wise with a much lower valuation. It doesn't seem like a totally crazy valuation to me, despite the uncertainties involved.
- vannevar 3y ago>Model training, though, is an up-front cost, not dissimilar to the cost needed to buy those Sun servers and Cisco routers in the dot-com era... This is only partially true even now, and I expect it will be less true in the future as continuous training becomes the norm. As Hericlitus said, you cannot step in the same river twice, and data drift is a real issue when modeling complex processes. It will become even more of an issue as the widespread use of models starts to impact the data streams they rely on for training: acting on a prediction can change the underlying assumptions that produced the prediction in the first place.
- version_five 3y agoNot that I disagree but I think this is what's going to pop the AI bubble. It doesn't actually work that great for a lot of stuff, anything that requires true generalization as opposed to just fitting a particular distribution. That doesn't make it useless, but it makes it way less useful than people believe in waves of optimism. It's what killed the last hype cycle and it will again.
- gmerc 3y agoIt didn’t pop the cloud bubble that you have to do constant maintenance. In the end, a new class of experts arises to handle these challenges, paid for by the layoffs of these made redundant by AI
- notfried 3y agoThere's a lot being said about the moat nVidia has with CUDA, but when companies like Tesla are forking $300M on 10,000 GPUs [1], it can't be that difficult to port whatever code to whatever platform if 100s of millions are in question, or is it? Can Google/Tesla/etc create an H100-like GPU in a couple of years at a fraction of the cost? And is CUDA really necessary if this much money is at stake? [1] https://www.tomshardware.com/news/teslas-dollar300-million-ai-cluster-is-going-live-today https://www.tomshardware.com/news/teslas-dollar300-million-a...
- varelse 3y ago[dead]
- smoldesu 3y ago> it can't be that difficult to port whatever code to whatever platform if 100s of millions are in question, or is it? > in a couple of years at a fraction of the cost? And is CUDA really necessary if this much money is at stake? I mean, that's the thing; is resisting CUDA really worth the cost when this much money is at stake? It's not like you have to pay to license CUDA. The two big drawbacks are that it's proprietary and locks you into their ecosystem; neither of which really matter when shipping stuff at that scale. These companies could spend a few million dollars to accelerate their specific codepath, but it's frankly wasted money unless you have a specific reason to avoid Nvidia. The eventual Nvidia-killer will probably be platform-agnostic tooling like ONNX, unless hardware manufacturers revive a sort of OpenCL-style acceleration library.
- 7speter 3y agoIsnt this what intels trying to do with OneAPI?
- smoldesu 3y agoYeah, but a lot of other companies have similar libraries with varying levels of commitment/coverage. ARM has ARMnn, Apple has CoreML, Intel has both Vino and OneAPI (plus SSE/AVX implementations), Google has NNAPI for Android and Google Cloud tensor accelerators, AMD has... Vitis/Xilinix, ROCm, OpenCL and MIGraphX, Windows has DirectML/Olive alongside Microsoft's Azure Execution Providers, Rockchip has RKNPU and Huawei has CANN. Suffice to say, there are a lot of "competing standards" a-la the XKCD : https://xkcd.com/927/ https://xkcd.com/927/ I don't think any of those will really topple CUDA, though. The best way to unseat Nvidia's dominance would be to target their two weaknesses; the closed nature of CUDA and the lock-in to Nvidia hardware. It would be difficult to overturn them both, but an open and fast CUDA alternative is really all people actually want. That's why I think libraries like ONNX have the right idea; instead of relying on chip manufacturers to not rip each other's throats out (they won't), they unify everyone's proprietary APIs. Barring some ground-up GPGPU library like OpenCL, this seems like the smartest path to me.
- markhahn 3y agoSeems odd not to mention competitors such as AMD. Not as if Nvidia has any secret sauce. "Analysts" like this also seem to misunderstand Cuda as that such a sauce, when in fact AI wants higher-level toolkits (which are not at all tied to Nvidia).
- smoldesu 3y agoNvidia does have secret sauce, though. That's kinda the point of CUDA cores and Tensor accelerators and RT cores, even. They are all secret (read: proprietary) and provide relevant "sauce" via performance improvements Nvidia monopolizes. It's arguably unfair, but just the way the cookie crumbles. Nvidia funded GPGPU drivers when AMD and Apple abandoned their cross-platform efforts. Nvidia funded early GAN and transformer-architecture papers, and incorporated their findings into the software layer. Analysts certainly misunderstand CUDA, but that doesn't change it's status as a non-negligible moat. It is a by-product of an overly hostile computer industry, spearheaded by a company that's more than happy to profit from bad blood.
- chaostheory 3y agoCUDA is the secret sauce. AMD has no equivalent, nor does it have a high level alternative. People have begged AMD for this for years and they’ve only started to take it seriously now.
- 0xcde4c3db 3y agoAMD's equivalent is HIP [1], for sufficiently flexible definitions of "equivalent". I can't speak to how complete/correct/performant it is (I'm just a guy running tutorial/toy-level ML stuff on an RDNA1 card), but part of AMD's problem is that it might not practically matter how well they do this because the broader ecosystem support specifically for the CUDA stack is so entrenched. [1] https://github.com/ROCm-Developer-Tools/HIP https://github.com/ROCm-Developer-Tools/HIP
- chaostheory 3y agoI’m not super familiar with HIP, but historically AMD’s past responses to CUDA only supported a small set of GPUs, was poorly documented, and was poorly maintained. It seemed like AMD’s attention span on these projects felt similar to Google’s attention span for new projects ie it’s a good bet that it will die in favor of a new SDK which will ultimately suffer the same fate
- helaoban 3y agoI think the point estimating GPU utilization (the terminology is transcending ), and by extension GPU demand misses the point. Of course they will buy them, they have to because everybody else is. The questions is whether the GPUs makes money for these companies. When the market sniffs the answer to that question, that's when the bottom falls out or not. Is Google going to make more money from me than it already does by embedding LLMs into its search product? Am I going to be spending any meaningfully more amount of time using any of these products than I already do by the addition of AI? Because if not where does the money come from?
- raphaelj 3y agoWhat if there is no money to win, but only a huge risk for big loss of market share for FAMG companies if they don't get of the AI train? Google Search might not earn more money it does now by buying Nvidia devices, but might loose big to a competitor if it does not.
- apozem 3y agoAs a PR gamer, I'm concerned the biggest graphics card maker makes most of its money selling to data centers bulking up AI capabilities. Like, if there's a shortage of GPUs in 2026 and Nvidia has to choose between selling limited inventory to AWS or individual gamers, it's obvious who wins (AWS and scalpers).
- WanderPanda 3y agoDon‘t expect to get gaming GPUs on the latest node for the next years
- satellite2 3y agoIt's really though to follow without units in the plots.
- samspenc 3y agoAt first I thought I was missing something and had to look at the plots a second time to realize that only 1 of the graphs was correctly labelled and the others are all missing legends :( which means you have to guess what each series corresponds to by reading the surrounding paragraphs.
- imaginebit 3y agoJensen Huang is probably the only founder that's still at the CEO job since the company's inception 30 years ago. What a ride!
- emadm 3y agoHe is indeed the longest serving CEO in Silicon Valley More impressive to me is that he didn’t let folk go because of the many downturns on the way
- blueboo 3y agoMorris Chang is a notable comparison. 36 years steering TSMC, a formidable person and leader
- phodo 3y agoWhat is a good book on how nvidia is run ?
- outside1234 3y agoI'm surprised here that he doesn't investigate: "Is NVIDIA the minicomputer of their era?" ie. Will an Intel (or indeed one of the cloud vendors) undercut their margin with a better priced GPU in a similar manner as Compaq did the IBM Mainframe?
- emadm 3y ago“ I have a hard time seeing what companies are going to go through the time and effort to port things that already run on CPUs to GPUs;” I mean someone will build an AI to do that right ^_^ Video and 3D are pretty much in the next year, all the components see there to dramatically shift cost structure and they need GPUs.
- optimalsolver 3y agoNvidia, on the mountaintop, his arms open.
- anigbrowl 3y agoOr, and hear me out here, Ben's previous analysis was just wrong and he failed to see what Nvidia's gameplan was. He writes as if they did some serious soul-searching when their stock price was low (perhaps even reading some brilliant analytical blogs!), but the reality of product development in the chip/peripheral space is that nothing happens that fast. Nvidia is riding high now because so many big bets that they made years ago are paying off at once.
- anurag6892 3y agoI am baffled when people say Nvidia got lucky with the recent AI wave. Alexnet, one of the first papers in 2012 to kickstart the current AI revolution was using Nvidia GPUs. Nvidia has been prioritizing AI research (both hardware and software) for the last decade.
- nocoiner 3y agoYeah, Ben’s primary talent seems to be weaving a narrative about how he’s successfully predicted 18 of the last 11 trends to reshape the industry, and to make it sound believable. Nvidia’s executing on all cylinders, and has been for a while (some missteps in the consumer marketing space notwithstanding). I’m still kicking myself a little for not buying some of their stock a year ago when it was obvious even to a simpleton like me that they were very well positioned to capitalize on current trends.
- lamontcg 3y agoActual monetization of AI is likely to be a large hurdle. Right now lot of companies are throwing shit at the wall to see what sticks in a panic to not get left behind. The downstream business models which will generate sustainable revenue to keep AI R&D running is somewhat lacking right now. That does smell like the 2001-era internet bubble. There's probably one Google-Search-level idea out there, but I'm not sure exactly which one it is. And remember it has to not only be a good idea, but it needs to be monetizable, with a substantial moat around it. So over the near term, 4-5 years I suspect AI hype comes back down closer to Earth again. Sure the secular trend is all up and to the right, but the secular trend of the internet was still up and to the right in late-2000 as well.