11 ms·
Nvidia CEO: We bet the farm on AI and no one knew it
- topherclay 3y ago"And it probably even runs Crysis." Woah, only one more year and this reference will be old enough to vote.
- mensetmanusman 3y agoI laughed at that as well. Kids these days won't understand the quote!
- sssilver 3y agoI’m tragically far from being a kid and I didn’t understand the reference. Would anyone be kind enough to explain?
- xnx 3y agohttps://knowyourmeme.com/memes/but-can-it-run-crysis https://knowyourmeme.com/memes/but-can-it-run-crysis
- sundvor 3y agoPurely from memory: It took a few years for hardware to catch up the computer game Crysis when it was released, to make it run smoothly. Pushing the limits of existing hardware, it looked truly spectacular when it came out - and many would say it still does.
- tormeh 3y agoCrysis is single-threaded, so CPUs still struggle with it. When the game was programmed CPUs were really single-core, so this was normal.
- deleted 3y ago[deleted]
- balls187 3y agoOthers explained it, has less to do with age, and more whether you are (were) a PC gamer. Crysis came out to huge fanfare due to it's impressive graphics. However even the highest end spec'd PC's had trouble running the game at a stable frame rate at high settings--iirc because the game's engine (cryengine?) was not well optimized. Crysis performance became a benchmark for PC's, and then the joke phrase "But can it run Crysis" started, used seriously when discussing PC hardward specs, and jokingly used for unrelated hardware "This printer has 24bit color?" "But can it run Crysis?"
- MeImCounting 3y agoI think kids these days definitely will understand this ancient and cliche joke. Its not like its some unkown twencen joke it gets said everytime nvidia comes out with the newest gaming behemoth cards
- A4ET8a8uTh0 3y agoHuh? Nvidia got lucky. First with crypto, then covid and then AI. I can give them credit for CUDA, because that was a true example of long term thinking, but to say they saw AI wave coming.. that is a stretch.
- ru552 3y agoNvidia has been powering the AI(ML) progress for the last 10 years and it's because they have the best hardware/software combo for processing vectors. There's nothing lucky about being continuously dominant in a space (GPUs) for 15+ years.
- A4ET8a8uTh0 3y agoHard disagree. Like with everything, there are multiple factors at play, but at certain size, decisions almost don't matter, because there is no one to upset the apple cart. As a counter, look at MS, they have been around for more than 10 years and there is plenty of luck, hubris, good decisions, bad decisions that did not matter, because they effectively held a dominant position. Being dominant equals to luck.
- Agingcoder 3y agoWell in that particular case they became dominant in the gpgpu space because they had a vastly superior offering ( cuda ), which they then capitalized on, while their competitors produced inferior products. I read my first gpgpu papers around 2005 I think , but the one company that ran with it was Nvidia. I don’t see this as luck. Once you are dominant though, you can stay that way for a long time.
- A4ET8a8uTh0 3y agoWe disagree, but that is ok. I am admittedly a little biased against nvidia. FWIW, your arguments are good. I think here it is a matter of perspective on what constitutes luck.
- 1-6 3y agoNo, Nvidia just found themselves in a lucky situation. They were already building GPUs mainly for gaming. Crypto then came along and swiped up a bunch of GPUs. When the self mining craze somewhat waned the AI craze started as the boundaries on its ethicality were broken down in an uncertain economic environment where corporations started racing to see who will get to the top.
- IG_Semmelweiss 3y agoYou are right. Even more interesting, is the timing itself: The crypto craze waned just as LLMs were picking up. Any more delay with LLMs, and perhaps nvidia would have been overextended with no demand to take their inventory. There may in fact , be no nvidia in that future depending on the level of the bet. Or take it 1 step further . if COVID hadnt happened, the crypto craze would never have occurred, and nvidia would have only been a bit-level player in the LLM craze we are now in. I still remember nvidia ads in pc game magazines. That and 3dfx. Who knew?
- qwytw 3y ago> and nvidia would have only been a bit-level player in the LLM craze we are now in Why? They were the only ones taking GPGPU seriously? AMD completely ignored it for years and Intel only became serious about GPUs very recently.
- dylan604 3y agoHow are you pinning the crypto craze to COVID? People were mining long before 2020, and that demand was so high putting pressure on GPU inventory that the manufacturers were artificially crippling their performance when used as miners.
- IG_Semmelweiss 3y agoCrypto prices really took off when speculation went thru the roof due to govt "stimmies". Look at the increase in $ nominal pricing of non-standard crypto (everything not BTC, ETH, xmr), the largest upward move recorded in history will be the period 20-22 in the aggregate NFTs at 100K , etc. Thats the "craze" Before that it was still a speculative play, but hardly pervasive and available to so many.
- chongli 3y agoStill seems like they were in the right place at the right time. When they first developed Cuda it was a hammer in search of a nail. Then they had the huge windfall from crypto-mining. That probably led to a lot of discussions on looking for GPGPU opportunities. Then AI came along and Cuda was just sitting there. Then they put two and two together and started investing heavily as they saw momentum build.
- sevagh 3y ago>Then they put two and two together and started investing heavily as they saw momentum build. There's been a decade or more of deep learning models breaking records in almost every single research field, powered (indirectly) through CUDA, cuDNN and other NVIDIA software. AI didn't "come along" when OpenAI released ChatGPT. DNNs that have been 99% NVIDIA-focused have been beating the state-of-the-art for years and years. Also for the record the ADA architecture (very dominant AI accelerator) was released when the stock price was like $100 (compared to the $500 now).
- velcrovan 3y agoYou could say that, for commercial purposes, AI actually did land with ChatGPT. It existed long before that, but that was unquestionably the event that started diverting billions of investment dollars into AI applications.
- KaoruAoiShiho 3y agoFor everyone except Nvidia yes, who had been spending billions on AI before then. That's why they're in the lead.
- ghaff 3y agoYou could say that "AI" has had potential for decades. It was also a great money pit for a very long time.
- chongli 3y agoI don’t think what you’re saying disagrees with my point. NVidia saw the momentum in AI research building long before ChatGPT arrived. AlexNet came out in 2012 and drew a ton of attention back then.
- wredue 3y agoHonestly, who would have ever thought that a shitty, squashed, artifact laden, completely fake frames that don’t mean anything architecture would win? Personally, I didn’t think it would, but the power of a small number in the top of your screen beats facts for most people. And here we are I guess. But there’s also the problem that AMD drivers are STILL shit. This is 20 straight years of poor drivers. Something tells me that if AMD would just get their software act together, the DLSS train may not have taken off the way it did. You do see a lot of comments that the drivers haven’t been bad for a while, but anecdotally, they definitely are.
- wwtrv 3y ago> shitty, squashed, artifact laden, completely fake frames that don’t mean anything architecture would win? I'm sorry but what does this even mean?
- I_Am_Nous 3y agoI think this is a dig aimed at DLSS, and the complaint seems to be that it's only meant to make framerates higher at the expense of quality.
- badsectoracula 3y agoI'm almost certain this refers to DLSS which uses "AI" (DLSS means Deep Learning Super Sampling) to generate a higher resolution output frame from smaller resolution renders by combining data from multiple frames over time using various AI approaches (i'm not exactly sure how) and, as of DLSS 3, being able to interpolate frames asynchronously from the rendering so that it can double the framerate. The process is not perfect and can introduce various visual artifacts, which are especially visible at lower monitor/output resolutions and the artifacts are more likely to occur when the render resolution is also much lower than the output resolution. These two also feed into each other as in general cheaper/weaker hardware (where the lower render resolutions would be used) tends to be paired with lower resolution monitors (where the artifacts would be more visible). I guess the "shitty, squashed, artifact laden" comes from there. DLSS 3 doubles the framerate by interpolating frames in the GPU (so the game doesn't "know" about them and player input isn't handled), hence "fake frames".
- broast 3y agoTo say that the AI craze started after the crypto wave died down is disingenuous or misinformed. The future need for GPU's was apparent as soon as machine learning became relevant a decade ago. The effectiveness of transformers, rnn's, q-learning, etc, for language and other applications was not news when GPT-3 launched. NVidia invested heavily for 10 years, including funding research towards ML and AI, and steered the direction of the technology that we have today
- EarthLaunch 3y agoThe article mentions this choice being made in 2018. I don't know the ML industry, but as a gamedev I had been mystified about Nvidia's strategy since about 2018. It felt like they weren't leaning into crypto, which surprised me. Instead it looked like they were trying to maintain gamer goodwill by not increasing consumer card costs during the boom. Of course scarcity raised secondary market princes, but Nvidia kept MSRP lower than the boom dictated. It seemed like they were betting against crypto during the craze. And sticking to their strategy on the consumer side. So maybe that's how they stuck to a ML strategy too. So they had all this CUDA stuff, which they must have invested in heavily because AMD showed what happens when you don't. That led to a software ecosystem for ML. Maybe it was all luck, but a strategic choice explains some of this in hindsight.
- nerdponx 3y ago> So they had all this CUDA stuff, which they must have invested in heavily because AMD showed what happens when you don't. That led to a software ecosystem for ML. CUDA was already digital gold in 2018. ML had moved to GPUs several years prior, and CUDA was a primary enabler of that transition.
- bonton89 3y agoNvidia had already been through one crypto bust at that point. The long view was that there will be another one and they wanted to keep their more stable markets viable for the future and not get demand slaughtered by mass dumping of used cards on the market when crypto dipped again. Of course, the AI thing exploded afterwards this time so the demand dip didn't happen.
- epolanski 3y ago> Instead it looked like they were trying to maintain gamer goodwill by not increasing consumer card costs during the boom. They've been selling mid-sized GPUs like the GTX 1080 at 800$ 8 years ago. A 300 mm2 GPU. They have been rising and rising costs for a long time to milk as many dollars as they could. People seem to forget even before the crypto craze the company had insane margins in their revenue. They weren't selling 800$ chips because those costed 600 or 500$ to produce... Even the most expensive 4090 is hardly more than a 400$ chip, memories included to build.
- blibble 3y agoyes, including NVIDIA
- deleted 3y ago[deleted]
- drunkan 3y agoAlways a divide between people in these threads who assign pure genius as the sole reason for success and those who live in reality and accept that you also need allot of luck and cash on the way.
- ghaff 3y agoYeah. I can absolutely believe that NVIDIA saw the potential for GPUs (and associated software) that went beyond hardcore gaming nerds building their own PCs. But HPC generally was not a very profitable market for most vendors and I don't really believe that crypto and LLMs as they have played out to date was especially foreseeable at a detailed level.
- renewiltord 3y agoI think forum post quality probably is well in decline when posters start making popular meta posts about how people with their view are in reality and people without are delusional.
- drunkan 3y agoIt was an observation of how every thread like this plays out not a “popular meta post”. I wouldn’t go as far as to say delusional I was more going for it’s naive to assign success purely to genius in the same way it’s naive to attribute a single cause or solution to climate change. In fact I think even that’s generous given that’s a future prediction that was not a guess or a gamble. Perhaps a better example would be for me to write a post about a massive successful stock trade or crypto where A) I had the cash to do it and B) things I gambled might happen went even better than I thought. There would be people assigning all the success to me when likely there were other similar plays I made that I lost big on as well as plenty of other people who saw it but simply didn’t have the means or timing to make it happen. So yes I think it’s naive to assign this and most to purely genius. You need a little luck and cash in reality on the way.
- einpoklum 3y agoActually, a GPU is not the best kind of hardware for AI (or rather, neural network simulation). It's very well-developed, and more useful than a CPU, but one could design and construct more NN-sim-oriented hardware. NVIDIA have been forced to do this somewhat, cannibalizing some of their more general-purpose compute capabilities in favor of matrix-multiply-add functionality (i.e. "tensor cores"). That's not exactly the "GPU way" of doing things. And one could go every further, perhaps all the way up to some analog computations instead of digital low-precision ones.
- cmrdporcupine 3y agoYeah I'm confused why e.g. Google's TPUs, etc. didn't catch favour in the market? I'm not an ML developer, so I'm curious. Just economies of scale?
- kimixa 3y agoThere's a natural compromise between "Efficiency" and "Flexibility" - training AIs is currently a fast enough moving field that by the time the really efficient targeted hardware could be released, the state of the art has moved to make them less suited to the latest generation. Outside of training, using the trained network for inference seem to be changing less, so maybe a decent target for bespoke targeted hardware. And indeed it seems that custom hardware blocks are very much "catching favor" in that market - everyone seems to be adding accelerators to their SoCs. GPUs seem to be at a happy medium, where they're often flexible enough to run techniques while still having better efficiency than a CPU.
- xxpor 3y agoWell the first issue is random researchers can't just buy a TPU and throw it in their workstation. (No, corals don't count)
- amelius 3y agoIt sounds to me that the head start nVidia thinks they have is very limited, considering that Apple built a serious GPU in just one generation...
- timschmidt 3y agoApple did no such thing. Apple's GPU IP was purchased from Imagination Technologies and is based heavily on PowerVR.
- itslennysfault 3y agoI have to admit I regret not buying their stock. It should've been obvious this would be a boon for them, but I got distracted by the crypto hype and didn't even think about the impact AI would have on them.
- shostack 3y agoTrue story, decades ago in HS we did the whole stock market competition. As a big gamer, I somehow convinced my team to dump everything into Nvidia. We were 2nd in the state in Illinois, and I wanted to cement our place and possibly win by selling everything to lock in gains in the final week. The person executing the trade on our team accidentally shorted it and it went up a considerable amount in the last week knocking us down quite a bit. At that point I seriously considered dumping my savings into Nvidia. I'd be retired right now if I had done so.
- skirmish 3y agoAs a big gamer at the time, my first stock purchase was TDFX. $1.5k was a lot for a student. Lost most of it pretty fast.
- gmays 3y agoThey'll also benefit from the boom on the graphics side as well. Once gen AI gets good enough to generate high quality video games, virtual worlds, etc. in real time, that will redefine gaming and entertainment. Why wait for the next Mission Impossible movie to come out when you can experience it...as Tom Cruise...with your own storyline with all of your friends. And get a new one every day.
- ilc 3y agoThe same reason why I read books from good authors. The curation of an experience is undervalued by many. Just like coding isn't about mechanics. It is about understanding requirements and coming up with solutions that meet needs
- gmays 3y agoI agree, but the art (e.g. what a good author does) comes from the structure, of which thousands of combinations could be created. Gen AI would then be able to endlessly fill in details for unique variations (different characters, locations, allegiances, time periods, decision trees, etc.). Think about any good story. A million details could be different, and it would still work well.
- ukuina 3y agoAnd role-playing games have shown us the way to have a curated overarching story while still enabling player agency. Many of those principles will apply to Generative Cinema. The current expectation that movie studios or the Hollywood machine will somehow be diminished by GenAI is misguided. If anything, it will normalize $100 movie rental "experiences" you can enjoy at home with no additional hardware besides your smartphone and a cast-enabled TV, with everything rendering real-time in the cloud.
- samstave 3y agoYou know what may be an interesting way for full immersion in 3D/AR - would be a Subnautica (SCUBA) style AR game. Because you would have 360 of movement, and critters could be projected through the water for you to fight, but youre actually wearing scuba gear... and being pulled around by an underwater "speederbike" with a laser.
- m3kw9 3y agoI think AIs work loads match what GPU does too well, some luck in it for sure but credit them making Cuda nice and early and doing bigger bets on AI than anyone else.
- ksec 3y agoInvesting billionS over the course of CUDA and its predecessors. The whole concept about wanting to use GPU for not just Graphics but High performance or Highly parallel computing started before 2000s. CUDA announced in 2007, and most of the work predate back to Cg in early 2000s. Even Intel who were already very late to the party made the decision to go invest and start Larrabee in 2005. And there was PS3 Cell, which started development in 2001. And yet all these work and success from Nvidia was because of, if you read 90% of HN comments for the past 2 years; Luck. They could have given up at any point in time for the past 20 years and simply not do anything CUDA or GPGPU related. Because who would want to do that when vast majority of those investment were not even bringing in much revenue. Like Intel decided to cancel Larrabee. They persevere and hit the Jackpot some 10-15 years later. But all of this was because of; Luck. Yes. Luck plays a big part. They could have continue another 10 years and they may never find the Killer App for it. But to ignore all the investment and work for such a long time and pin it down to Luck was about as rude and as disrespectful it can be. Especially on a forum which was started by VC with the spirit of entrepreneurship.
- bryanlarsen 3y agoIt does help to have billions to invest. AMD in the last 20 years was basically broke and they bet the farm on Zen. If they split their limited resources between Zen and CUDA they probably would have failed at both. But their Zen bet has paid off and now they're playing catch up. Intel, OTOH, I'm not sure what their excuse is.
- narrator 3y agoIMHO, Intel lost a couple of years because the CEO had a consensual affair with a subordinate so they fired him and put the CFO in charge for a while and puttered around unable to fix the serious process manufacturing problems getting to 10nm they encountered which caused them to fall behind in manufacturing to TSMC. Finally, after a few years of little progress, Gelsinger was hired, and we'll see what he can do.
- baq 3y ago
- xpuente 3y agoI wonder what will happen if someone figures out that fused FP mult add is no longer needed (e.g. just count spikes and add subtract permanence). This could be a big problem for the guys with all their eggs in one basket (like NVIDIA).
- zarzavat 3y agoThis is what I believe as well. There's no way that FMA is the optimal way to compute NNs in silicon. It's overly precise. NVIDIA will be okay though, they have the volume to get the newest nodes first. Only a few can compete with them.
- manicennui 3y agoThey pivoted from the previous fad.
- latchkey 3y agoDiscussions on similar submissions: Nvidia CEO: We bet the farm on AI and no one knew it https://news.ycombinator.com/item?id=37055375 https://news.ycombinator.com/item?id=37055375 (August 8, 2023 — 10 points, 4 comments)
- clwg 3y agoOnce they changed the licensing on consumer gear in a DC it started to become clear they were executing on a strategy, I wouldn't be surprised if phasing out SLI was part of that strategy as well.
- itomato 3y agoIt sure looks a lot like the crypto and AI bets were the same as the GPU and gaming bets, just at a different scale. Is this acknowledging the game market is dry?
- karaterobot 3y agoI could definitely see them having the foresight to predict that the future would pay good money for a bulk mathematical operations of a certain type. I have trouble imagining them predicting AI specifically, when crypto and gaming were paying the bills so well. If I went back to 2018, I wonder if he'd say they bet the company on bitcoin back in 2012.
- emmender2 3y agothe ceo has driven a unique culture as seen in his recent interviews. some of these run counter to prevailing business wisdom: long term projects, hard problems that could build platforms/markets vs easy problems that gain market share etc..
- HashThis 3y agoIntel sure gave up. Intel for AI chips is what IBM is for operating systems.
- cybereporter 3y agoThe catch was they are betting multiple farms. One farm for crypto, another farm for AI, and I'm sure they'll have another farm for another hyped technology.
- parentheses 3y agoThis is a stretch. Ray Tracing was the next frontier of visual quality. The compute was at a level where something like this was possible. DLSS was not a "huge gambit". It was an application of AI models (many of which train and run on NVidia chips already) to the gaming space. Making it sound like it was a "genius move" is great for promoting NVidia as being an innovator.
- fennecbutt 3y agoLmao no they didn't, they bet the farm on cuda for scientific work, which goes hand in hand with consumer graphics market (essentially the same hardware). They've just pivoted to AI semi recently (considering their long history) using the same hardware as always, for graphics/scientific/AI workloads. Sure they tweak vram amount/bandwidth/support additional precisions but it's all really same old same old. Just with more transistors every 2 years.
- onlinebettingid 3y ago[flagged]