11 ms·
Nvidia in the Valley
- wslh 4y agoOfftopic: Stratechery has a podcast at [1] including the translated interview with Nvidia CEO [2]. The weird thing from the marketing/conversion perspective is that the interview translation says "To listen to this interview as a podcast, click the link at the top of this email to add Stratechery to your podcast player." instead of having a direct link in the web page. [1] https://open.spotify.com/show/1jRACH7L8EQCYKc5uW7aPk https://open.spotify.com/show/1jRACH7L8EQCYKc5uW7aPk [2] https://stratechery.com/2022/an-interview-with-nvidia-ceo-jensen-huang-about-building-the-omniverse-cloud/ https://stratechery.com/2022/an-interview-with-nvidia-ceo-je...
- draw_down 4y ago
- digdugdirk 4y agoThis article lays out a solid overview as to how Nvidia got to where they are now. I'm curious (as someone without a deep knowledge of the technology or the industry) as to why AMD can't create a similar dedicated ray-tracing functionality in their chips? It seems to be where the industry is going, and the article later goes on to point out how Meta and Google are doing this themselves. Why has AMD ceded this market? Is it a patent issue? Capability issue? Something else?
- BudaDude 4y agoI'm also curious why AMD hasn't implemented something like CUDA cores for ML. AMD cards are basically useless for doing any intensive ML task.
- smoldesu 4y agoThey did try. A few years ago AMD and Apple collaborated to make OpenCL, which was a pretty half-hearted attempt at building a platform-agnostic GPGPU library. Their heart was in the right place, but that was part of the problem. Nvidia's vertical control over their hardware and software stack gave them insane leveraging power for lots of dedicated use cases (video editing, gaming, 3D rendering, machine learning, etc.) In the end, even after years of development, OpenCL was just really slow. There wasn't a whole lot of adoption in the backend market, and Apple was getting ready to kick them to the curb anyways. It's a little bit of a shame that AMD got their teeth kicked in for playing Mr. Nice Guy, but they should have know that Nvidia and Apple race for pinks.
- paulmd 4y agoOpenCL had a bit of a "second-mover curse" where instead of trying to solve one problem (GPGPU acceleration) it tried to solve everything (a generalized framework for heterogeneous dispatch) and it just kinda sucks to actually use. It's not that it's slower or faster, in principle it should be the same speed when dispatched to the hardware (+/- any C/C++ optimization gotchas of course), but it just requires an obscene amount of boilerplate to "draw the first triangle" (or, launch the first kernel), much like Vulkan, and their own solution is still a pretty clos HIP was supposed to rectify this, but now you're buying into AMD's custom language and its limitations... and there are limitations, things that CUDA can do that HIP can't (texture unit access was an early one - and texture units aren't just for texturing, they're for coalescing all kinds of 2d/3d/higher-dimensional memory access). And AMD has a history of abandoning these projects after a couple years and leaving them behind and unsupported... like their Thrust framework counterpart, Bolt, which hasn't been updated in 8 years now. https://github.com/HSA-Libraries/Bolt https://github.com/HSA-Libraries/Bolt The old bit about "Vendor B" leaving behind a "trail of projects designed to pad resumes and show progress to middle managers" still reigns absolutely true with AMD. AMD has a big uphill climb in general to shake this reputation about being completely unserious with their software... and I'm not even talking about drivers here. This is even more the widespread community perception with their GPGPU/ML efforts than with their drivers. http://richg42.blogspot.com/2014/05/the-truth-on-opengl-driver-quality.html http://richg42.blogspot.com/2014/05/the-truth-on-opengl-driv... AMD doesn't have a library of warp-level/kernel-level/global "software primitives" like Cuda Unbound or Thrust either. So instead of writing your application, you are writing the primitives library, or writing your own poor implementation of them. https://github.com/NVIDIA/cub https://github.com/NVIDIA/cub https://github.com/NVIDIA/thrust https://github.com/NVIDIA/thrust It's just a fractal problem of "the software doesn't exist and AMD would really rather you write it for them" all the way down and nobody wants to do that instead of doing their own work. AMD is the one who benefits from the rewrite, for everyone else it's a "best case scenario it works the same as what we've already got", so if AMD isn't gonna do it then pretty much nobody else is gonna leap on it. And then AMD has poor adoption and no software and the cycle continues. AMD really really just needs to get serious and hire a half dozen engineers to sit there and write this software, cause it's just not going to happen otherwise. It's a drop in the bucket vs the sales to be realized here even in the medium term, like one big ML sale would probably more than pay those salaries. They're not doing it because they're cheap or they're doing it because they're not really serious, take your pick, but, AMD is no longer that broke, they can afford it and it makes financial sense. Again, not a "nice" thing to say but it's the cold truth here. I feel like I've made some variation on this post about every 6 months for like 5 years now but it's still relevant. If you as a vendor don't care about writing good code for key features/libraries for your product, nobody else is either, and you'll never get uptake. It's the same thing with AMD/ATI not embedding developers with studios to get those optimizations for their architectures. Console lock-in will only get you so far. If you don't care about the product as a vendor, nobody else will either. It's remarkable how much flak Jensen got for "NVIDIA is a software company now" back in 2009, and how people still don't get it, AMD is not a software company and that's why they keep failing. Writing the framework that turns into StableDiffusion and sells a billion dollars of GPUs is the NVIDIA business model, AMD keeps trying to jump straight to the "sell a billion dollars of GPUs" part and keeps failing.
- paulmd 4y agoAMD has "tensor cores" (called something different but they're very similar matrix accelerator units) in CDNA. RNDA3 is supposed to have "something", it has the same instruction as CDNA, it's supposed to be less than a full unit but presumably there wouldn't be an instruction without some level of hardware acceleration either. The bigger problem is that AMD doesn't want to pay to keep up on the software side... at the end of the day when you're coming from behind you just have to pay someone to port key pieces of software to your platform. AMD has really coasted for a long time on letting the open-source community do their work for them, but that's not going to fly with things like PyTorch or other key pieces of software... if AMD wants the sales and the adoption of their hardware, it's just going to have to pay someone to write the software, so that people who want to do research and not PyTorch maintenance can justify buying the hardware. I am not particularly interested in the perceived historical justifications for the current situation, it doesn't matter to the businesses who might be AMD's customers. And actually in many ways they've gotten even shakier recently, what with dropping RDNA support from their NN/ML package. As a cold statement of reality, this is table stakes going forward and if AMD doesn't want to do it they won't get the sales. It's not even just PyTorch either, it's... everything. AMD is just coming from a million miles behind on the software, and "welp just write it yourself if you want to use our hardware" is not an attitude that is conductive to selling hardware.
- rektide 4y agoWhich libraries is AMD dropping RDNA support in? That seems very inadvised. Nvidia's libraries being usable by a broad range of developers on a wide range of hardware is critical to their wide adoption. AMD cannot expect to have real adoption if only their fancy enterprise grade unobtanium cards support ML systems. AMD needs a wide & engaged community trying to yse their stuff to figure out what software/drivers they simply have to build.
- paulmd 4y agoTalking specifically about ROCm here, their ML package. God this is such a tough paragraph to write accurately. AMD themselves have conflicting information all over their docs and repos and half of it is not even marked as "outdated"... https://docs.amd.com/bundle/ROCm-Getting-Started-Guide-v5.2.3 https://docs.amd.com/bundle/ROCm-Getting-Started-Guide-v5.2.... The official supported platforms at this point are RDNA2 (pro), GFX9 (pro), and CDNA. Consumer versions of these (RDNA2, Radeon VII, and Vega 56/64) probably work, although Vega 56/64 are an older version with much less hardware support as well. RDNA2 support is also "partial" and ymmv, things are often broken even on supported cards. If RDNA2 works, then RDNA1 may work, but again, mega ymmv, things may not even be great with RDNA2 yet. The "hardware guide" link talks about supporting Vega 10 (that's V56/64) and says GFX8 (Polaris) and GFX7 (Hawaii) are supported... but that doc is tagged 5.0 and 5.1 was the release that dropped the other stuff. So I'd say Vega 64/56 chips are probably broken at this point, on the current builds. Up until earlier this year though, it was unsupported on any consumer card except Radeon VII. They dropped Hawaii/Polaris/Vega support about 6 months before they started adding partial RDNA2 support back. And in contrast... NVIDIA's shit runs on everything, going back 10 years or more. At least to Kepler, if not Fermi or Tesla uarch (GTX 8800 series). It may not run great, but CUDA is CUDA, feature support has been a nearly forward ratchet, and they've had PTX to provide a rosetta stone in between the various architectural changes. I mean... at the end of the day the hardware hasn't changed that much, surely you can provide a shader fallback (which is required anyway since RDNA2 doesn't have tensor acceleration). I don't get what the deal is tbh. https://www.techpowerup.com/288864/amd-rocm-4-5-drops-polaris-architecture-support https://www.techpowerup.com/288864/amd-rocm-4-5-drops-polari... https://www.phoronix.com/news/Radeon-ROCm-5.1 https://www.phoronix.com/news/Radeon-ROCm-5.1
- ActionHank 4y agoAMD already has dedicated raytracing hardware on their GPUs, but are behind Nvidia. PC games that opted for Nvidia raytracing earlier on run poorly with an AMD GPU with raytracing turned on. Cyberpunk 2077 is an example of this, runs beautifully on Nvidia gpus with rt on, framerate falls through the floor on an AMD card. Raytracing on the "next gen" consoles PS5 and XBox Series X is done using AMD hardware and runs really well.
- yazzku 4y agoIndeed. The platform the devs target is very relevant. Often one can get caught up just comparing RT across vendors, but the reality is that the implementations are different and probably make different trade-offs. It's therefore no wonder that console games often outperform on AMD, and NVIDIA-signed games likewise on NVIDIA cards.
- ckozlowski 4y agoI'm theorizing here, but I suspect it's because AMD feels like building out a dedicated or proprietary capability could really hurt them if it didn't take off. By that logic, NVidia's risk here could hurt them as well (and that they are taking a risk is the point the article it trying to make.) AMD has for a long time favored an inclusive, compatible approach. First (that I can recall) with x86-64, more recently with AdaptiveSync over G-Sync, and now with their Ray Tracing approach. Each time they chose a move efficient path that was open to the industry as a whole. This seems to have had some pros and cons. On the one hand, they've been able to keep up with the market with a solution that is the best value for them. They've never been a large company against the likes of Intel and NVidia, so I suspect there's less appetite for risk. On the other hand, by always going that route, they cede the leadership role to others, or if they do have leadership, it's not in a way they can really leverage. It becomes commoditized. Note how when the industry was moving to 64bit, AMD ended up setting the direction over IA-64 with their more inclusive approach. But it didn't turn into any significant leverage for them. They set a standard, but it was one that everyone else then adopted, including Intel. So I feel like while AMD's approach keeps them alive and always in the running, it's an approach that will never put them on top. Whether or not this is a bad thing really depends on what the goals of the company are, and if the the goal is to remain steadily in the race, then they're doing great. But arguably, NVidia pulls the industry in directions by way of its choices. They're risky and sometimes irritable. It's also put them in front. So in my opinion, AMD hasn't ceded the market, but they have ceded leadership in many instances by their safe approach. It's still profitable and safe for them. But they'll always remain second place as a result.
- bee_rider 4y agoIt makes sense -- as the underdog they need to erode entrenched advantages, starting up a standards-based compatible approach is a cheap way of doing so (on top of being totally laudable and good for the community). I wonder if we could ever see Radeon Rays on Intel's GPUs, or even their iGPUs. Raytracing in every low-resource-requirement MOBA, I say!
- yazzku 4y agoThe Intel ARC does seem to handle RT/DXR: https://game.intel.com/story/intel-arc-graphics-ray-tracing/ https://game.intel.com/story/intel-arc-graphics-ray-tracing/
- gamdevthrowaway 4y ago> as to why AMD can't create a similar dedicated ray-tracing functionality in their chips? They do and it works well. > out how Meta and Google are doing this themselves. Meta and Google develop products everywhere all the time. The author doesn't play or develop games, so it's okay that he doesn't really know anything or can meaningfully comment on it. He just took what Huang said and Ctrl+C Ctrl+V'd it. WHY DO PEOPLE CARE ABOUT RAYTRACING? Photoreal gets financing. For your game, for your crypto thing, whatever. Raytracing makes photoreal demos at pre-financing costs. Also essential reason why Unreal Engine is appealing. Unity is for people who make games, Unreal is for people who finance games. WHY DO PEOPLE CARE ABOUT AI-GENERATED CONTENT? The Darwinian force here is the same: people believe you can make a game (or whatever) out of DALL-E or whatever dogshite. They don't believe you when you say you would hire an artist in Indonesia for the same cost (or whatever). So you'll get financed by saying one and not the other. The reasons why don't really matter. It's idiosyncratic. You're going to spend the money however it is. Just like every startup. Also the AI generation thing attracts people who think they're the smartest, hottest shit on Earth. That attitude gets financing. Doesn't mean it reflects reality. DO THESE TECHNOLOGIES MATTER? I don't know. What does Ben Thompson know about making fun video games? It's so complicated. I doubt Big Corporate or VC capital is going to have financed the innovative video game that uses raytracing or AI generated content. It's going to be some indie game developer.
- 411111111111111 4y ago> Also essential reason why Unreal Engine is appealing. Is that why unreal engine deprecated ray tracing? You're honestly quiet clueless considering your phrasing. I bet you haven't worked in a large studio working with unreal engine either.
- gamdevthrowaway 4y ago> Is that why unreal engine deprecated ray tracing? Unreal Engine didn't deprecate ray tracing, they are using the same DirectX DXR APIs in a different place. But I think you already know that. > I bet you haven't worked in a large studio working with unreal engine either. Have you?
- samstave 4y agoamd seed was intel having to lit give them chip designs... in the 90s. google was secretly making their own motherboards in ~2004 that were multi proc "meta" (fucking idiot name) was building a crap ton of secret datacenter hardware and architecture in the 2010s... and they are part of the secret sauce... (source ;;worked for all in diff capacities)
- Maciek416 4y agoIMO, a major ingredient of raytracing running well enough in a game that also looks as good as any other current AAA title in raster-only mode has been DLSS. Raytracing is (or at least, at time of 2xxx series GPUs, was) still quite expensive to run at full res at resolutions (1440p, 4K) and framerates (60,120,144) that PC gamers demand. However, rendering raytraced games at a much lower resolution is just within reach for dedicated CUDA hardware. So DLSS makes up the difference with very sophisticated upscaling. Without DLSS, I think the raytracing in titles like Cyberpunk 2077 might not be performant enough. In light of this, you might go back and see that AI and RT for NVidia have gone hand in hand, because one enables the other to be performant enough for AAA titles. Opinions may vary greatly on this, but personally, I don't think AMD's FSR upscaler is capable of matching what DLSS can do in this regard. (Intel's upscaling does seem to be capable of doing it, but very high performance parts are still some ways away from release).
- paulpan 4y agoPersonally I'm very eager to see AMD's upcoming RX 7000-series from a pricing as well as performance standpoint compared to Nvidia's new 4000 series. As noted in the article, "Nvidia likely has a worse cost structure in traditional rasterization gaming performance for the first time in nearly a decade" due to the much lower die costs that AMD is targeting. I predict Nvidia's share price will continue its downward trajectory - both on the weakness of 4000 series (given high price and surplus 3000 series inventory) and on AMD pricing pressure. What's more interesting is Nvidia's long term focus on ray tracing and continuing to dedicate more and more precious die space to it. AMD, on the other hand, seems to be more focused on the short term: rasterization performance. It's a bit reminiscent of Apple vs. Samsung, where AMD is Apple as it waits on technologies to become mainstream before full adoption and Nvidia is Samsung as it bets on new technologies (e.g. foldables).
- maerF0x0 4y ago> I don’t think we could have seen it. I don’t think I would’ve done anything different, This is a CEO admitting they essentially learned nothing, will not admit they made a wrong choice in light of data, and typically means they will do it again. They could have seen the writing on the wall about how people were angry about crypto emissions and that proof of stake was being bandied about as a solution (and that Cardano already had it, so it's not just a theory).
- johnla 4y agoI read that more as CYA than anything.
- monkmartinez 4y agoThe article kind of led with Crypto, but could have easily started and ended with Crypto. Full Stop. Overlay Ethereum-USD and Nvidia charts for the past 5 years and what does that tell you? My take is both Nvidia's stock price and Ethereum-USD price were products of helicopter money. Sure some gamers bought cards, but not on the scale to which miners acquired them. Analysis of mining hash rate post-merge bears this out[0]. With some estimates being $5 to $20 Billion(USD) in newer GPU's that are no longer "profitable."[1] The 'chip' shortage meant Nvidia could not satisfy demand for their products. I posit no amount of chips would have satisfied demand. They, along with many other companies, made record profits during the pandemic. There was just soooo much 'extra' money flowing around with stimulus, overly generous unemployment, PPP, and more. I can't tell you how many people were YOLO'ing every cent of their stimulus into Crypto and WSB stonks. It was an enormous cohort of people based on the explosion of Robinhood and Coinbase use mentioned in WSB subreddit. Mooning and Diamond hands FTW, eh? Mining crypto with gainz from a roulette spin with Robinhood options? Yeah, while we are at it, lets buy 4 mining rigs because mining Ethereum is very, very profitable during this time. The thinking that one can literally turn electricity to heat while making money (even while one sleeps no less) and trade options while one is awake. It may look crazy right now, but the subreddits were non-stop talk like this. There are mining rigs all over my Facebook marketplace and local craigslist now. Crypto winter is here (for who knows how long) and Nvidia is not going to make those types of returns for the extreme foreseeable future. Reality check 101. [0]https://twitter.com/WuBlockchain/status/1552837630278385664 https://twitter.com/WuBlockchain/status/1552837630278385664 [1]https://www.theblock.co/post/168380/whats-left-for-ethereum-gpu-miners-after-the-merge https://www.theblock.co/post/168380/whats-left-for-ethereum-...
- jejeyyy77 4y agoAfter crypto it will be ML and general cloud computing.
- monkmartinez 4y agoHow many people do you think are 'into' ML enough to spend $1k+ on a SOTA gpu and associated hardware? I am slowly getting there having moved from Colab to my own set up... However... Ethereum enabled/lured many everyday joes into buying 4+ $1k cards due to the incentive structure of; 'buy mining rig then buy a lambo.' Setting up a GPT-NeoX is orders of magnitude more difficult than pointing GPU compute at Nicehash. I really have a hard time thinking ML will have any meaningful uptake in that regard because the incentive structure isn't the same and its much, much harder. Big cloud seems to be going there own way in regards to compute. GPU's are great for ML, but that doesn't mean they will always hold the crown. TPU's, NVMe storage, and chiplets may find a better path with newer software. I just don't see how Nvidia really thrives without drastically reducing price (less margin). I don't think they are dead, but they are in big trouble as are many companies.
- Jsharm 4y agoIs a GPU previously used for mining worth anything in the second hand market? I was under the impression it thoroughly knackered them out.
- causi 4y agoThere are a number of seriously conflicting stories. Some of them say "the cards were individually tuned and undervolted to run at maximum efficiency to make the most money so they'll be fine" and some say "these cards were overclocked and left to run in a boiling hot shipping container then they washed them off with a water hose".
- bentcorner 4y agoLTT goes over it pretty well (IMO): https://www.youtube.com/watch?v=hKqVvXTanzI https://www.youtube.com/watch?v=hKqVvXTanzI tldr: Cards (like any piece of other electronics) do have a lifespan, but mining doesn't affect that. Cards that are kept clean and in better working conditions will run faster.
- neogodless 4y agoResults may vary. But I used my Radeon RX 6700 XT for mining nearly 24/7 for about 10 months (between purchase and when it paid itself off), while using it for gaming in between (I'd obviously stop mining). It ran around 65°C during that time. Very low core clocks, but memory was run at close to the maximum recommended speed by AMD's Adrenalin software. At least so far no signs of any problems.
- m3kw9 4y agoWith gfx slowly trending towards cloud and edge computing, I wonder how that benefits them, or not?
- stephc_int13 4y agoNot sure about this trend. The idea of a dumb terminal had been around forever, and so far, it has been cyclically going up and down. In my opinion, we'll always have both.
- dotnet00 4y agoI've been hearing about this for a while but has any mainstream game actually demonstrated meaningful realtime graphics streaming? I suspect that kind of like NFTs or Metaverse, most developers see that it's a pretty bad idea in a practical sense, but talk about it because it's easy PR. People just barely tolerate games which require an internet connection to run for DRM, I can't imagine them appreciating the requirement for the connection to also be fast and stable enough for streaming, especially with handheld PCs starting to catch on. Especially since they'll also want to take down the expensive servers quickly after sales fall off, most likely making the games unplayable.
- SketchySeaBeast 4y agoI played with Microsoft Flight Simulator 2020 gamepass streaming. It was fine, games like that don't require fractions of a second response time, it looked like I was watching an interactive high compressed youtube video of the game set to medium, but the whole time I was going "Why don't I just play the prettier version on my PC?"
- squeaky-clean 4y agoThere's several games released on Nintendo Switch that run only via cloud streaming. The Kingdom Hearts switch "ports" are all streamed. It's also the only way to play Fortnite on iOS after Apple removed Fortnite from the app store. https://www.epicgames.com/fortnite/en-US/mobile https://www.epicgames.com/fortnite/en-US/mobile > People just barely tolerate games which require an internet connection to run for DRM While some people are generally very loud about this on Reddit and gaming forums, the average person doesn't seem to care. Even people who complain loudly about it online will quietly buy it if it's the only choice. It reminds me of that old screenshot of a Steam group dedicated to "Boycotting Modern Warfare 2" in 2009. The day after release? Most of the group was playing it. https://i.kinja-img.com/gawker-media/image/upload/s--W8ZYHe9O--/c_scale,f_auto,fl_progressive,q_80,w_800/18j48weujcgewjpg.jpg https://i.kinja-img.com/gawker-media/image/upload/s--W8ZYHe9...
- wing-_-nuts 4y agoNV saw the profits it made from the shortages of the last mining boom, and determined that it was better to make a much higher profit even at the cost of shipping fewer units. They went full bore on the 'costs and tdp don't matter'. They saw that people were willing to pay any price for cards that were 5% faster at a higher power draw. Only, the mining boom is over, there are a mountain of 3000 series cards floating around out there, and NV is sweating. The flood of used mining cards is going to make this the first good time to buy a GPU in years and no amount of shenanigans with 4000 series cards is going to change that math.
- adolph 4y ago40 years from now someone will make good use of those in a documentary . . . https://en.wikipedia.org/wiki/Atari_video_game_burial https://en.wikipedia.org/wiki/Atari_video_game_burial https://en.wikipedia.org/wiki/The_Mystery_of_Al_Capone's_Vaults https://en.wikipedia.org/wiki/The_Mystery_of_Al_Capone's_Vau...
- johnla 4y agoWhere's the best place to pick up these cheap cards? eBay?
- wing-_-nuts 4y agoebay, fb marketplace, r/hardwareswap
- izacus 4y agoThis sounds like a win for nVidia in any case, since it'll entrench their RTX, CUDA, NVENC and DLSS moats, making them ubiquitous targets for games and driving purchasing decisions in the future. But they'll need to wade out a generation for that - which probably isn't the first time.
- gitfan86 4y agoOnce I got my hands on stable diffusion, I bought a 3090 because I was afraid that they would go up in price, but my power supply wasn't big enough and I returned it for a 2060. But now I see that 3090s are dropping like 40% in price since then. This article does a great job explaining these dynamics. Metaverse and crypto will be a bust, but democratized AI is going to explode, the big risk for NVDA is that models and tools get small and efficient enough that they don't need $1,000+ hardware.
- flyinglizard 4y ago$1,000 is a very reasonable enterprise price point. After all, datatcenter CPUs are much more expensive.
- bongobingo1 4y agoI think democratizing AI means more than "a very reasonable enterprise price point" of $1000.
- smoldesu 4y agoIt doesn't, you can run this on $150 GTX 1060s if you're willing to wait a few moments. The interesting angle here is that there is a consumer segment of hardware (gaming GPUs) that can be used to drive cool artistic experiments. I think for most people, even non-gamers, getting dedicated acceleration hardware is not any more expensive than an entry-level analog synthesizer.
- aidenn0 4y agoWith only 4GB, I'm RAM limited for a lot of models. I'm thinking of buying a dedicated GPU just for ML stuff.
- Dennip 4y agoWon't enterprise always go for the quadro cards which are more like $4000+
- stephc_int13 4y agoI am not worried about Nvidia. They will clearly suffer for a while, a bad year or maybe two, not enough to sink the company or to kill the golden goose. They are spreading themselves a bit thin with all their projects, but I can see them succeeding with enough of them to be in a better relative position 2-3 years from now. GPUs are becoming a general-purpose data-plane computing platform, this not simply related to gaming, crypto or AI training, but everything.
- russli1993 4y agoif chiplet is the silver bullet to die costs, I don't get why Nvidia won't go for it. After all, Nvidia has smart ppl too. There must be some design tradeoffs that made Nvidia engineers to believe their approach is still the best in terms of perf and area. For 4090 and 4080 price, I think Nvidia strategy is: they are higher tier, with 3000s as the lower tier more affordable option. They feel they can succeed with this strategy in the current market (1 year or so) given the competitive landscape. Then they can use 4090 and 4080s to drive up the ASP and margins. Their biggest motivation is sustain the stock price.
- zackmorris 4y agoI hadn't heard the term chiplet before, thank you! When I got out of school in the late 90s, system-on-chip (SoC) was a pipe dream. It has issues because memory might have different requirements than CPU, so it's hard to put all of the components on a single die. I always thought the situation was frankly pretty silly, because I didn't want one big die anyway. I wanted a scaleable grid of chips like the 3D processor from the Terminator 2 movie. It took over 20 years, but maybe we'll have a chance to get something like that with an open source RISC-V. Maybe an array of matchhead-size CPUs at 1 GHz costing $1 each that could be scaled to hundreds or thousands of cores with content-addressable memory for automatic caching and data locality. Then it could be treated as a single processor with access to a one large shared memory space and we could drop the (contrived) distinction between CPU/GPU/TPU/etc and get back to simple desktop computing rather than dealing with the friction of vertex buffers. My guess is that Nvidia doesn't want any of that to happen, so works to maintain its dominance in single-die solutions.
- paulmd 4y ago"match-head sized chiplets" sort of falls into the chiplet mythos I think. Chiplets aren't magic, they actually increase power usage vs an equivalent monolithic chip, data movement is expensive and the more data you move the more expensive it is. People just think chiplets are efficient because AMD made a huge node leap (GF 12nm to TSMC 7nm is like, more than a full node, probably at least 1.5 if not 2) at the same time, but chiplets have their own costs. The smaller you split the chiplets, the more data is moving around. And the more power you'll burn. It's not desirable to go super small, you want some reasonably-sized chiplet to minimize data movement. Even if you keep the chiplets "medium-sized" and just use a lot of them... there is still some new asymptotic efficiency limit where data movement power starts to overwhelm your savings from clocking the chips lower/etc. And there's copper-copper bonding to try and fix that, but that makes thermal density even worse (and boy is Zen4 hot already... 95C under any load). Like everything else, it's just kicking the can down the road, it doesn't solve all the problems forever.
- yuan43 4y ago> I [nvidia CEO] don’t think we could have seen it [massive effect of Ethereum merge on bottom line]. I don’t think I would’ve done anything different, but what I did learn from previous examples is that when it finally happens to you, just take the hard medicine and get it behind you…We’ve had two bad quarters and two bad quarters in the context of a company, it’s frustrating for all the investors, it’s difficult on all the employees. This is not confidence inspiring. It was obvious that the Etherum merge would affect the bottom line in a big way. Why this professed ignorance? Does it have to do with the fact that to admit that it was visible a mile away would have been to admit the deep reliance the company had come to have on the short-term Ethereum mining boom?
- AceJohnny2 4y agoAs the article says, the timing on the Ethereum dropping proof-of-work was shorter than Nvidia's production pipeline.
- vineyardmike 4y agoI think we forget that Silicon manufacturing is planned a lot farther out than Silicon shopping. They were likely trying to make TSMC purchase orders in the start of the pandemic, before a crypto boom. They also tried to handicap their GPUs wrt crypto. They likely didn’t expect the absolute shit show of a chip shortage (because who predicted or understood the pandemic early). The rest of the market was desperate, and they probably expected it to be more robust than it ended up being. The merge would have been so far away at the time that they wouldn’t predict if it would happen at all nevermind when.
- opportune 4y agoI think Huang does not want to draw investors’ attention to crypto because he doesn’t want people to equate Nvidia’s performance as a company with crypto performance. He doesn’t want Nvidia to just be a crypto company. At the same time, he also definitely wants to cash in on any future crypto booms, because they are lucrative. It is best for him to take a position that mostly ignores crypto. I think he legitimately doesn’t want crypto to be the future of Nvidia and doesn’t want to build for that use case, nor does he want to be financially reliant on it, but there is also no point in him talking shit or spreading doom about crypto when he can just shut up and still sell gpus.
- Melatonic 4y agoThis guy really loves his leather jackets eh?
- Night_Thastus 4y agoCalling it a "valley" almost seems silly. They're returning to normal after a boom perpetuated on smoke. Nvidia will be fine. Investors don't like to see it because they somehow couldn't comprehend that the growth they saw was completely artificial (how is beyond me), but the company will be fine. Their latest decision with the 4000 series was smart though. They realized suckers will pay insane amounts for the cards, even disregarding prior crypto. So, make 4000 series insanely expensive. That will drive sales of 3000 series to empty the over-supply and make their relatively lower prices look like a steal. In the end, they get people to way over-pay on both the 3000 and 4000 series. Double dipping!
- izacus 4y agoI wonder if "the investors" are mostly just AI trading algorithms with impulse control and intelligence of a 6 year old. Nothing else explains the short sightedness of modern markets.
- GekkePrutser 4y agoI think the investors are just hopping stocks. Nvidia was generating extreme profits, now that that's over they'll jump to another hypey thing. Energy perhaps. They don't care about the companies they back. Just about money. It's causing good companies with a long-term vision to suffer (note I'm not considering Nvidia one of these) and promoting the hollow-shell money grabbers and pyramid schemes. I don't know how it can be solved though.. We've made this situation ourselves by speeding business up to "the speed of light". Perhaps a bigger role for governments in investment but I know that's cursing in the American church of the free market :) But in the long term we really have to find some stability back in the system IMO.
- lmm 4y agoIMO the instability was always "really" there, but reduced information flow hid those fluctuations. Maybe we just need to get used to the instability - business is risky and will have ups and downs, responding quickly ultimately makes the system more efficient in the long run.
- treis 4y agoLots of people talking about the economics but my take away from the article was that we're on the cusp of something really cool. The combination of ray tracing, physics via ray tracing, and GPT like content generation are all the ingredients needed to make huge immersive worlds. Imagine GTA with every house, office, and sky scraper full of unique realistic looking people doing realistic things in a fully destructible environment.
- spicyusername 4y agoThe last paragraph really sums it up In other words, Nvidia has earned the right to be hated by taking the exact sort of risks in the past it is embarking on now. Suppose, for example, the expectation for all games in the future is not just ray tracing but full-on simulation of all particles: Nvidia’s investment in hardware will mean it dominates the era just as it did the rasterized one. Similarly, if AI applications become democratized and accessible to all enterprises, not just the hyperscalers, then it is Nvidia who will be positioned to pick up the entirety of the long tail. And, if we get to a world of metaverses, then Nvidia’s head start on not just infrastructure but on the essential library of objects necessary to make that world real (objects that will be lit by ray-tracing in AI-generated spaces, of course), will make it the most essential infrastructure in the space. These bets may not all pay off; I do, though, appreciate the audacity of the vision, and won’t begrudge the future margins that may result in the Celestial City if Nvidia makes it through the valley.
- TechnicolorByte 4y agoIt’s a very good summary. Nvidia to me gets a lot of flak (sometimes rightfully so) in large part to being the big risk-taker in the GPU/graphics/AI space that pushes forward industry trends. AMD, meanwhile, is largely a follower in the GPU/graphics space with few contributions to rendering research. Even worse, they even use their marketing to angle themselves as consumer-friendly when I reality they’re just playing catch-up. For instance, they started off badmouthing ray-tracing as not being ready back when Turing launched (when is any new paradigm ever “ready” when it requires developers to adapt?) before adopting it with much worse performance the following generation.
- AtlasBarfed 4y agoWell, if that "consumer friendliness" is usable Linux drivers, then I don't give a shit about NVidia pushing the envelope, even if it means the graphics holy grail of real time raytracing. And is NVidia really the primary pusher of graphics algorithms and AI? Yeah, I doubt it. SUre they might contribute some things, but modern fabs have so much available transistor real estate that really NVidia is just trying to maintain market control by defining the computing interfaces rather than some fundamental achievement in computing theory. Raytracing algorithms aren't new, and they are "embarrassingly parallel" like most graphics algorithms, very well suited for modern chip fab design. If NVidia went away, Sony/Microsoft/Nintendo would just find another graphics vendor for real time raytracing. There were "processor per pixel" raytracer experiments in the mid 1990s when 66 MHz was "fast". If anything, real time raytracing likely has been suppressed by the massive investments in rasterization toolchains.
- bullen 4y agoHow far off can you be: electricity is never going to become cheaper. Right now playing 5 hours of 1060 PC games costs $1 in EU. To even think of selling something that draws more than 30W is ridicoulus. The metaverse has to scale DOWN to 5W Raspberry 4. VR/120Hz/RTX are completely out of the question.
- ThomPete 4y agoThere is going to be no end to demand in the future for Nvidia unless it's going to another chip producer or another technology (like quantum chips) It's really that simple IMO. AI have just started becoming mainstream and it will most certainly play a big part in whatever gets us out of our current situatins. Disclaimer: I invested very early in nvdia stocks and is long on them.
- vimota 4y ago>Similarly, if AI applications become democratized and accessible to all enterprises, not just the hyperscalers, then it is Nvidia who will be positioned to pick up the entirety of the long tail. How does this square with Cloud providers themselves being hyperscalers ? What's to stop Google/AWS/Microsoft's hardware divisions from outpacing Nvidia since those businesses themselves may need the hardware and can then provide it to end users of their cloud platforms.
- magarnicle 4y agoGood point. I guess the long tail is anyone who wants to run their own hardware. The cloud makes that market smaller.
- kaycebasques 4y agoIs there any kind of precedent where bad news for the semiconductor manufacturers means good news for specific downstream industries? Examples? I.e. the oversupply of chip X allowed industry Y to buy more chips resulting in innovation Z...
- blagie 4y agoI've worked AI into my day-to-day workflow to an extent where I'm simply not worried about NVidia. It's like the early days of the internet, or of computing. I can do things my friends can only dream about. The key risk to NVidia is if someone catches up to them. Intel. China. AMD. Whomever. However, if they maintain their lead, the demand will come.
- cavisne 4y agoWhats stopping them just selling the excess chips to hyperscalers? They already force them to buy "Datacenter" chips (pure price discrimination). Why not cut them a license to sell the gaming chips in a cloud environment. There is obviously shortages of GPU's for AI training on all public clouds, and the price (due to the above price discrimination) is very high.