3 ms·
> After seeing the NVidia presentation announcing their latest datacenter-scale AI hardware Did we watch the same presentation? NVidia knocked it out of the pa
by dragontamer 4y ago
> After seeing the NVidia presentation announcing their latest datacenter-scale AI hardware
Did we watch the same presentation? NVidia knocked it out of the park.
Thread block cluster is obviously amazing. Routing between SMs / compute units will be far faster with this level of software abstraction, and it will be exceptionally easy to write code for. NVidia always impresses me with their advanced software techniques and clear understanding of the fundamental model of SIMD compute.
------
Ignoring those software details... the important thing is GH100 will be TSMC 4nm, which is 1.5 nodes ahead of the 7nm Dojo. A significant process advantage, representing 60+% less power usage and 300% the transistor density of the older 7nm tech.
Even if NVidia's GPU had issues, there's something to be said about just being a raw process node (or 1.5 nodes) ahead.
- pengaru 4y ago> Did we watch the same presentation? NVidia knocked it out of the park. Perhaps I worded it poorly, I agree with you. My meaning was vs. NVidia's latest tech it seems like Tesla's in-house datacenter NN could be nothing more than a huge cost center without even offering an advantage over what NVidia could sell them. But like I said, if you have a staff of folks capable of building such things you have to keep them satisfied with practicing their craft or they leave.
- dragontamer 4y agoGotcha. Misread for a sec.
- sufiyan 4y agoThis was the case when Google launched their TPU as well. Look where they are now
- p1esk 4y agoWhere?
- atty 4y agoThe person you were replying to agreed with you, that it seems like Nvidia is doing a great job in the data center.