3 ms·
650 TOPs Is surprisingly low for narrow precision datatypes - I assume they are quoting the fastest performing datatype (Int8 or maybe even lower!). That's on p
by buildbot 3y ago
650 TOPs Is surprisingly low for narrow precision datatypes - I assume they are quoting the fastest performing datatype (Int8 or maybe even lower!). That's on par with an A100, an H100 hits 2 PETA TOPs (4 PTOPs 2:4 sparse!) of Int8!
- teruakohatu 3y agoEveryone was trying to get their hands on A100s right until the H100 was released. If Amazon can replace A100s that’s a big win.