6 ms·
Nvidia Kicks Off the Next Generation of AI with Rubin
- TSiege 9mo agoExtreme Codesign Across NVIDIA Vera CPU, Rubin GPU, NVLink 6 Switch, ConnectX-9 SuperNIC, BlueField-4 DPU and Spectrum-6 Ethernet Switch Slashes Training Time and Inference Token Generation Cost Technical details available here https://developer.nvidia.com/blog/inside-the-nvidia-rubin-platform-six-new-chips-one-ai-supercomputer/?ncid=no-ncid https://developer.nvidia.com/blog/inside-the-nvidia-rubin-pl...
- metalliqaz 9mo agoElon's emoji-filled blurb for that press release is the most cringe things I've seen this week.
- deleted 9mo ago[deleted]
- cinntaile 9mo agoI find all the blurbs weird, do they usually include that? If not, why now? It doesn't look professional.
- bredren 9mo agoI think it is interesting. Is there any other company in a position today that could put together endorsement quotes from such high ranking people across tech? Also: Tim Cook / Apple is noticeably absent.
- utopiah 9mo agoThat's because of financial links. They are so intertwined propping up the same bubble they are absolutely going to share quotes instantly. FWIW just skimmed through and the TL;DR sounds to me like "Look at the cool kid, we play together, we are cool too!" without obviously any information, anything meaningful or insightful, just boring marketing BS>
- mrandish 9mo ago> They are so intertwined propping up the same bubble they are absolutely going to share quotes instantly. Reading this line, I had a funny image form of some NVidia PR newbie reflexively reaching out to Lisa Su for a supporting quote and Lisa actually considering it for a few seconds. The AI bubble really has reached a level of "We must all hang together or we'll surely hang separately".
- XorNot 9mo agoWhy is that interesting?
- bredren 9mo agoIt could be an indicator that Apple is not as leveraged up on NVIDIA as to provide a quote. Cook did make a special one of a kind product for the current POTUS, so he is nothing if not pragmatic.
- saaaaaam 9mo agoQuotes from known names in a boring corporate press release are absolutely standard. It gives journalists a hook to build a story. “Elon Musk says new Nvidia tech is…”
- cinntaile 9mo agoYou're right they usually do this, I checked some press release from last year. The big difference is that it's now the CEO that had to write the blurb instead of (e.g.) a vice president of product.
- saaaaaam 9mo agoYeah I imagine that when the stakes are as high as they are with Nvidia they pull out the biggest names possible, partly to drive media but also as social proof. “All these important CEOs are prepared to go on the record - not just corporate droids who have to because it’s their job”.
- dataking 9mo agoBecause standing out gets attention?
- saaaaaam 9mo agoI wonder what the significance of a green heart is, in Elon-world.
- Groxx 9mo ago... it took a couple searches to figure out that "extreme codesign" wasn't actually code-signing, but "co-design" like "stuff that was designed to work together"
- alfalfasprout 9mo agosame I was so confused
- pyuser583 9mo agoMe too. Good style says to avoid creating words with dashes - it’s Un-American. But clarity matters more than rules.
- gilrain 9mo agoIs there any American style guide that insists hyphens be avoided even when a closed compound would cause ambiguity? I follow Chicago, but I imagine other style guides also already emphasise clarity.
- mortehu 9mo agoWouldn't "code sign" be two words in English? And "code signing" rather than "code sign"?
- deleted 9mo ago[deleted]
- Groxx 9mo agoMostly yes, and I prefer it that way, but it does get smashed into a single word sometimes. "co-design" I've mostly only seen hyphenated, though I don't see it often enough or in broad enough contexts to really claim anything about the frequency in a general sense. Maybe it's caused by `codesign` tools? Like `codesign --extreme` which probably requires two signers to sign one thing?
- utopiah 9mo agoEven << "co-design" like "stuff that was designed to work together" >> sound strange to me. Typically when I read about co-design is stuff that was designed together, by more than 1 party.
- dannersy 9mo agoRiveting.
- codyb 9mo agoIf their new platform reduces inference token cost by 10x, does that play well or not well with the recently updated GPU deprecation schedules companies have been playing with to reduce projected cost outlays? For context, my understanding is that companies have recently moved to mark their expected GPU deprecation cycles from 3 years to as high as 6 which has huge impacts on projected expenditures. I wonder what the step was for the Blackwell platform from the previous. Is this slower which might indicate that the slower deprecation cycle is warranted, or faster?
- m3kw9 9mo agobut token required for quality generation may increase as much very soon.
- codyb 9mo agoYea, definitely a good point. Going to be interesting to see how it plays out. I definitely do not have the expertise to answer the question
- UltraSane 9mo agoCompanies are playing games with GPU depreciation.
- causal 9mo agoUnsure why you were downvoted; I'm curious to understand this comment. Playing finance and accounting games I presume you mean.
- UltraSane 9mo agoYes they are depreciating GPUs for longer than usual time periods like 6 years.
- cmxch 9mo agoThe only thing learned from structured finance was to lock regular people out.
- Animats 9mo agoTheir own CPU, too - 88 ARM cores. So it's an all-NVidia solution - CPU, interconnects, AI GPUs.
- tibbydudeza 9mo agoAfaik MediaTek helped them with the CPU part.
- 2OEH8eoCRo0 9mo agoRebuild all the data centers!
- metalliqaz 9mo agolol haven't even started building half the Blackwell datacenters yet
- mk_stjames 9mo agoWhenever I see press on these new 'rack scale' systems, the first thing I think is something along the lines of: "man I hope the BIOS and OS's and whatnot supporting these racks are relatively robust and documented/open sourced enough so that 40 years from now when you can buy an entire rack system for $500, some kid in a garage will be able to boot and run code on these".
- wmf 9mo agoThe firmware is UEFI and Vera should have good upstream support. The GPU driver is proprietary though, so you'll have to dig up the last supported version from 2036.
- deleted 9mo ago[deleted]
- criemen 9mo agoWhat's the power hookup to just boot one rack? I'd imagine that's more than you get anywhere in residential areas for a single house.
- embedding-shape 9mo agoHopefully in 40 years we'll all be running miniature cold fusion power or something, so we can avoid burning the planet to the ground.
- MisterTea 9mo agoDepends on the residence. I have personally seen a large house in Brooklyn with dual 200 amp 120/208 volt three phase services (two meters, each feeding a panel.) I have seen someone setup an old SGI rack scale Origin 3000 systems in their garage. I think they even had an electrician upgrade their service to accommodate it.
- wmf 9mo ago170 kW
- exacube 9mo agodoes anyone know how well this 5x petaflop improvement translates to real world performance? I know that memory bandwidth tends to be a big limiting factor, but I'm trying to understand how this factors into it its overall perf, compared to blackwell.
- wmf 9mo agoThe blog post has more technical details and fewer quotes from customers: https://developer.nvidia.com/blog/inside-the-nvidia-rubin-platform-six-new-chips-one-ai-supercomputer/ https://developer.nvidia.com/blog/inside-the-nvidia-rubin-pl...
- mrandish 9mo agoThat link was somewhat clearer, thanks. As a software guy who follows chip evolution more at a macro level like: new design + process node enabling better cores/tiles/units/clocks + new architecture enabling better caches, busses, I/O == better IPC, bandwidth, latency and throughput at given budget (cost, watts, heat, space) - I've yet to find anything which gives a sense of Rubin's likely lift vs the prior generation that's grounded in macro-but-concrete specs (such as cores, tiles, units, clocks, caches, busses, IPC, bandwidth, latency, throughput). Edit: I found something a bit closer after scrolling down on a sub-link from the page you linked (https://developer.nvidia.com/blog/inside-the-nvidia-rubin-platform-six-new-chips-one-ai-supercomputer/#3_six_new_chips_one_ai_supercomputer https://developer.nvidia.com/blog/inside-the-nvidia-rubin-pl...).