4 ms·

Nvidia's last gen...

• jsnell 4y ago
  That's addressed in section 7.4 of the paper: > The Google tradition is to write retrospective papers after systems are deployed and running production apps. Both TPU v4s and A100s deployed in 2020 and both use 7nm technology. The newer, 700W H100 was not available at AWS, Azure, or Google Cloud in 2022. The appropriate H100 match would be a successor to TPU v4 deployed in a similar time frame and technology (e.g., in 2023 and 4 nm).
  • deleted 4y ago
    [deleted]
  • revelio 4y ago
    That's not really addressing the point though, is it. That tradition at Google evolved when they had technology that was well ahead of their competitors, which they currently are not and therefore this paper is more like a marketing document than a recruiting resource. It's inevitable that people will want comparisons before buying TPU access and giving them a mapreduce style paper that comes out years after the technology is mature isn't going to satisfy them.
• fooblaster 4y ago
  Have you tried to get an h100? Its not really possible right now