Without error correction, these benchmarks are going to be a bit weird and fluffy. It’s a bit like racing a half-built car. There’s the other bit of complexity

Without error correction, these benchmarks are going to be a bit weird and fluffy. It’s a bit like racing a half-built car. There’s the other bit of complexity that the connectivity matters a great deal. Supercomputers can be connected on a grid, torus, fat tree, etc. and the different connectivity will lend to different problem solving capabilities in a somewhat subtle way. Hence different benchmarks highlight different capabilities, and correspondingly, each company will push a benchmark that makes their machine look the best.