3 ms·
> Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). Just a nitpick on
by brandonnnn 3y ago
> Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something).
Just a nitpick on this point, can you elaborate?
Are you talking about Grace? (Which is a Hopper H100 with an ARM CPU glued to it)
- ilaksh 3y agoYes.. didn't realize it had an H100. So I was a little bit mislead by the advertisement copy. But still could be significantly more efficient the way everything is integrated.
- brandonnnn 3y agoNo worries, yes it does look like quite a mean chip. Though, please note that NV give their FLOPS as 'sparse flops' which is ~double the FLOPS the chips get for dense matmuls. This can trip you up when comparing numbers!