5 ms·
Nvidia to Share New Details on Grace CPU, Hopper GPU, NVLink Switch, Jetson Orin
- dougmwne 4y agoSeems like this will end up driving more research into very large ML models. Some of the performance benchmarks here are for trillion parameter models. I’ve observed that often Innovation directly follows silicon improvements.
- deleted 4y ago[deleted]
- kube-system 4y ago> Grace CPU uses LPDDR5X Looks like we’re finally going with soldered RAM in the data center?
- BeefWellington 4y agoThat's pretty much inevitable I think when chasing density.
- d110af5ccf 4y agoWhy can't we have both? L4 cache anyone?
- adrian_b 4y agoThere are chances that in the future data centers the DIMM sockets from the CPU boards will be replaced by a combination of soldered DRAM on the CPU boards, for the lowest latency, combined with separate memory boards attached to the CPU through CXL links, for high capacity memories that can be allocated flexibly to the CPU boards, and that can be replaced or expanded independently of the CPUs.
- formerly_proven 4y agoIntel has already shown Sapphire Rapids samples with 64 GB of HBM 2e [1]. It's a safe bet that the HBM is not exclusive with external main memory. That'll be DDR5 of course, not CXL. Maybe in the 5th gen? [1] https://www.anandtech.com/show/17422/intel-showcases-sapphire-rapids-plus-hbm-xeon-performance-isc-2022 https://www.anandtech.com/show/17422/intel-showcases-sapphir...
- vimy 4y agoThat’s probably how the new M2 Mac Pro is going to work.
- ac29 4y agoM2 supports CXL?
- WithinReason 4y agoThis is what I was wondering. Or why isn't there something like a 2 GB HBM2 cache on GPUs? Is it cost or latency?
- mhh__ 4y agoIBM have been working with eDRAM in mainframes as cache, but mainframes and servers do different jobs.
- shreyshnaccount 4y agograce and hopper? from stranger things?
- deleted 4y ago[deleted]
- Agingcoder 4y agoNo grace hopper the computer scientist
- KineticLensman 4y ago> the computer scientist She was a maths PhD who became a US Navy Rear Admiral, along the way leading the team that developed the COBOL language and compiler [0] [0] https://en.wikipedia.org/wiki/Grace_Hopper https://en.wikipedia.org/wiki/Grace_Hopper
- mynameisvlad 4y agoFrom your own link, literally the first sentence of the article. > Grace Brewster Murray Hopper was an American computer scientist I'm not sure why you're trying to be pedantic here, she is widely recognized as one of the pioneers of computer science.
- accoil 4y agoI don't think KineticLensman is being pedantic. Those look more like examples of her being more than a mere "computer scientist", and expanding on her accomplishments. I know I forget that she was a Rear Admiral.
- mynameisvlad 4y agoI disagree. There isn't really a reason to quote out specifically the "computer scientist" part and begin with saying she had a Math background. That indicates disagreement with the quoted text.
- hamburglar1 4y agoAre the vertical-specific Nvidia SDKs like DRIVE and Clara widely used?
- what-imright 4y agoI want one. Damn hotchips always has stuff I want and then can never afford even when it gets to market