4 ms·
They're so non confrontational. Their performance comparisons are against "CPU". Just come out and say it, even if it's not apples to apples. If the 3D-torus in
by tinco 4y ago
They're so non confrontational. Their performance comparisons are against "CPU". Just come out and say it, even if it's not apples to apples. If the 3D-torus interconnect is so much better, just say how it compares to NVidia's latest and greatest. It's cool that midjourney committed to building on TPU, but I have a hard time betting my company on a technology that's so guarded that they won't even post a benchmark against their main competitor.
- jeffbee 4y agoThe paper compares it to A100. https://arxiv.org/pdf/2304.01433.pdf https://arxiv.org/pdf/2304.01433.pdf
- ttt3ts 4y agoNvidia's last gen...
- jsnell 4y agoThat's addressed in section 7.4 of the paper: > The Google tradition is to write retrospective papers after systems are deployed and running production apps. Both TPU v4s and A100s deployed in 2020 and both use 7nm technology. The newer, 700W H100 was not available at AWS, Azure, or Google Cloud in 2022. The appropriate H100 match would be a successor to TPU v4 deployed in a similar time frame and technology (e.g., in 2023 and 4 nm).
- deleted 4y ago[deleted]
- revelio 4y agoThat's not really addressing the point though, is it. That tradition at Google evolved when they had technology that was well ahead of their competitors, which they currently are not and therefore this paper is more like a marketing document than a recruiting resource. It's inevitable that people will want comparisons before buying TPU access and giving them a mapreduce style paper that comes out years after the technology is mature isn't going to satisfy them.
- fooblaster 4y agoHave you tried to get an h100? Its not really possible right now