8 ms·
Nvidia Unveils Blackwell, Its Next GPU
- flerchin 3y agoIs Nvidia using AI to help design new GPUs? When that happens we're actually off to the singularity. Until then, I can't tell if we're in a bit of hype mode.
- aurareturn 3y agoExplained here: https://www.youtube.com/watch?v=HxyM2Chu9Vc https://www.youtube.com/watch?v=HxyM2Chu9Vc Quite interesting.
- paulmd 3y agoiirc also discussed a bit here as well https://www.youtube.com/watch?v=JXb1n0OrdeI https://www.youtube.com/watch?v=JXb1n0OrdeI
- Q6T46nT668w6i3m 3y agoI believe “world models” are the future of the field so I really need better performance in areas like IVP, FFT, special functions (e.g., harmonics), and dynamic programming. The H100 advances (e.g., DPX instructions) are terrific but they feel like a starting point. Hell, improved geometric operations (e.g., triangulation and intersection) would be killer too and surely that expertise exists at NVIDIA! The H100, especially for the price, feels terrible when you’re training a neural network bottlenecked on an operation that flies on a consumer CPU when you know there’s GPU optimizations that have been left on the floor.
- tgtweak 3y agoI suspect these can be patched in as well - most of these functions have implementations in CUDA implying they should be able to run on the hardware even without dedicated instructions.
- rbanffy 3y agoThis was one of the selling points for RISC: to focus on the most frequently used instructions and implement the rest in software would yield smaller and faster designs. I have the feeling that GPUs are on the sweet spot where smaller footprint directly translates into more executions and, therefore, higher throughput for the same chip area.
- transcriptase 3y agoIt would appear the G in GPU now stands for AI.
- deleted 3y ago[deleted]
- zacksiri 3y agoThey might re-purpose the G to Generative Generative Processing Unit works for all cases.
- m3kw9 3y agoWhen AI is in everything, G would become General
- black_puppydog 3y agoTogether with the newly-peripheral PPU (formerly known as CPU)
- m3kw9 3y agoCPU is gonna be the coprocessor when most things are inferenced instead of strictly calculated.
- sesuximo 3y agoApu already taken by aviation tho
- treme 3y agoCrazy that video game graphics business happened to be the secret level portal to AI land
- falcor84 3y agoIn hindsight I think it makes good sense - game graphics were always aiming to represent worlds with as high fidelity as possible.
- barumrho 3y agoGood point, but it is interesting that the computations to render visual worlds in high fidelity is the same computation to "ingest" the data to create a model. Reminds me of how a mic is a speaker and speaker is a mic.
- AYBABTME 3y agoI think it speaks to the generalizability of linear algebra.
- p_l 3y agonVidia claims that they went into video games because it provided a way to fund their goal of compute accelerators
- amelius 3y agoThen why does my graphics card have 5 video outputs?
- packetlost 3y agoI don't believe that claim one bit. That reads like revisionist history if I've ever seen it. If there's sources that back it up, fine, but until I see pretty reasonable proof I'm going to take that as CEO grandstanding while the market is hot.
- 3y ago
- Solvency 3y agoIf this thing is all about AI why are we calling it a GRAPHICS processing unit still? Don't tell me it's because of familiarity with the word GPU. Nvidia could coin a new acronym and write a PR release and the entire world would circulate it and even discuss it in here and every other vendor would scramble to play catch-up.
- __s 3y agoAlready there's the addition of TPUs, tensor processing units
- Nullabillity 3y agoPresumably they still want something to sell once the bubble pops.
- dotnet00 3y agoThe improvements focus on AI, but it's still a GPGPU oriented chip. Due to how language works, it doesn't really matter that graphics isn't the main focus anymore, the chip still follows the same basic architectural principles as what is expect of a modern GPU, thus it is a GPU.
- whywhywhywhy 3y ago> Don't tell me it's because of familiarity with the word GPU It's because of familiarity with the word GPU...
- dragonwriter 3y ago> If this thing is all about AI why are we calling it a GRAPHICS processing unit still? Because names are sticky, and no one wants to start evangelizing a new term (“Matrix Math Processing Unit”) for it, preferring to put energy into things with value.
- samstave 3y agoI'm just super curious where these chips will be in 10 years - not the state of the chip design - these physical chips. It will be interesting when chips such as this percolate down to single folks using one of these to just run their home AI node. When every building has just one of these in their core building AI system that allows for all the regular talk to your smart home and have it intelligently accommodate your inferred needs/intentions. Its possible today - but I mean on a wide scale.
- syrgian 3y agoI am not hopeful at all that it will go that way. Instead, I expect those buildings to invest in having the fastest, most stable internet connection with added redundancy and everything will be fully centralized in datacenters.
- samstave 3y agoFair - I guess these will be relegated to 'Evil Lair Under Ground Bunker'(TM) types - like Zucks Hawaii compound's internal datacenter on-prem. EDIT: the 10-year is just a random number. And while these chips will obviously eventually be obsoleted as far as their cutting-edge - that doesnt remove the usefulness of such a chip for as long it can logic electrons. So even by any future standard - as few of these thrown in more a consumer space will be adding of value for a long time, one would think. I'd be really interested in knowing about fab re-tooling. I recall one night at Intel in 1997 or so - I stepped onto the balcony to have a smoke at about 1am. There was another guy there who was in finance and we had a similar smoke schedule - and we would chat. He was lamenting about the difficulty in his work was to re-work a lot of DB schemas because some of the numbers he had to entire as far as finances, were too large for the fields. I never forgot that - or a common trope that was thrown around intel at the time - I was in my early 20s and was focused on video games when at Intel - so I didnt get to follow along with this: "Its cheaper to just build a new fab than to retool one for the next iteration of processor" -- so I wonder just how much ancillary waste happens these days with each new chip iteration/evolution. Meaning - all the amounts of resources that went into the fab to make such a chip - and where these wind up in their lifecycle. The newest machines to make the ultra EUV chips are ~$380 million a piece (which is nothing these days on a scale - but on a unit basis, thats a Fton. https://www.cnbc.com/2022/03/23/inside-asml-the-company-advanced-chipmakers-use-for-euv-lithography.html https://www.cnbc.com/2022/03/23/inside-asml-the-company-adva... https://i.imgur.com/say0bnv.png https://i.imgur.com/say0bnv.png
- bionhoward 3y agoIf everyone and their cousin is bullish on compute, then what’s the bear thesis here? Why might compute NOT be the best answer to our challenges as software engineers? Why might a focus on compute scaling ultimately be inferior to something else? I seek all kinds of answers, including ones about fundamental logic, mathematical physics, etc
- Cacti 3y agoI mean the entire tech industry is predicated on a continued exponential growth of computer power. It could be this 70 years and next couple dozen are a blip of what will be millennia of linear returns.
- whamlastxmas 3y agoI mean I could baselessly argue that the second we have AGI, we will very shortly after have ASI, after which I think most computing could very likely be hundreds or thousands of times more efficient. It’s possible there exists far more computing power in the world than we will ever need.
- vinyl7 3y agoIf we focus on writing better software with performance in mind instead of this insane stack of abstraction disaster, we could easily get massive increases in compute capability with current hardware. The most impressive thing about modern computing is that we've had exponential increase in compute speed, yet everything runs as slow as it did 30 years ago
- whiterknight 3y agoThese giant GPUs aren’t getting more efficient, they draw even more power to do more work. It’s impressive and will have important use cases. But fundamentally technology gets better when we can do more with less.
- dotnet00 3y agoThey are getting more efficient. They draw say, 2x the power, but do 4x the work. The H100 is apparently ~5x more efficient than the A100.
- lakomen 3y agoHonestly, idk what that means. Is it a 4xxx successor? What's the point? Why, as a consumer who likes playing video games, do I have to buy a "GPU" that isn't primarily a GPU? Maybe I'm getting old
- jug 3y agoI'm not sure what you mean. You don't have to buy this GPU and it's clearly not geared towards gaming any more than the A100 was.
- pjmlp 3y agoWith an "OS" to go along with it, https://www.nvidia.com/en-us/data-center/products/ai-enterprise/ https://www.nvidia.com/en-us/data-center/products/ai-enterpr... It is this kind of delivery that the competition misses out.
- amluto 3y agoI imagine that Nvidia is trying to build a more sustainable moat. If the only things they have that their competitors don’t are a nice development framework, nice libraries and nice drivers, it’s not that hard for a customer to get their software working on a competing hardware platform and cut out a bunch of Nvidia’s enormous markup. But if Nvidia also strong buy-in with datacenter operators and an entire platform to magically run people’s applications without having them need to think about how they’re deployed, then they can try for an AWS-like moat in which customers want to avoid the ongoing cost of DIYing their stack.
- gitfan86 3y agoAssuming that the hardware isn't a moat because other people make similar hardware is a mistake. The networking alone is a huge bottleneck at scale. A competitor has to be better at networking AND chips to be competitive.
- shiftpgdn 3y agoTiny corp/tinygrad has been working for a year+ and has raised something like $5 million dollars to try to get AMD chips up to speed to Nvidia, without much success. Check out twitter where George Hotz has been very vocal about AMD needing to open source their chips to allow someone to help them get up to speed.
- fotcorn 3y agoConsumer AMD chips to be precise. AMD is mostly focusing on their datacenter chips (MI300X), and I assume the support for AI workloads there is much better. They might even see their consumer chip undermining sales of datacenter chips. NVIDIA got big because CUDA works on the most crappy notebook GPUs up to their most powerful chips, and AMD should do the same, but focusing their limited number of driver devs on the expensive enterprise hardware makes sense IMHO.
- flohofwoe 3y agoBut Can It Run Crysis? (seriously though, don't call it a "GPU" when rendering takes the back seat)
- ksec 3y agoI guess Blackwell is too late in the design cycle to use N3. It would be interesting to see, at these sort of margin and volume. Would it make sense to have GPU on latest node? Next Gen 3nm GPU in 2025 and if they could move aggressively 2nm GPU in 2026.
- ChrisArchitect 3y agoLots more discussion: https://news.ycombinator.com/item?id=39749646 https://news.ycombinator.com/item?id=39749646
- captainbland 3y agoI'm sure it will be a very impressive part but the performance claims sound too good to be true. "up to 30 times the inference performance, and up to 25 times better energy efficiency"
- edward28 3y agoMostly marketing shenanigans.
- dsir 3y agoDoes anyone know the numbers in layman's terms regarding the demand for compute and what our systems/chips are able to reasonably process with this new tech? I'm curious if the technology is now vastly out preforming the demand here or if the demand for compute is outpacing the tech.
- trueismywork 3y agoDemand is infinite