It’s 25Gbps between instances, and NVLINK between GPUs on the same instance. It’s really a pretty comparable setup. There’s no network cost within a region, an

It’s 25Gbps between instances, and NVLINK between GPUs on the same instance. It’s really a pretty comparable setup. There’s no network cost within a region, and you’re probably not downloading terabytes of data out of AWS — so you’re talking about a few dollars a month, as opposed to tens a day in GPU cost. (You’d also have 23TB of RAM in your cluster, if that’s enough for you to use as storage.)