One of the issues faced in super computing isn't just raw horsepower or more cpu's, it's latency. It's not enough to just connect a ton of machines via ethernet

One of the issues faced in super computing isn't just raw horsepower or more cpu's, it's latency. It's not enough to just connect a ton of machines via ethernet, you need specialized hardware to provide high-throughput sharing of data.