> Would this even be possible to do, given that the latency between nodes is very high and the bandwidth limited? Yes, it's possible. But no, it would not be r

> Would this even be possible to do, given that the latency between nodes is very high and the bandwidth limited? Yes, it's possible. But no, it would not be remotely sensible given the performance implications. There is a reason why Nvidia is a multi trillion dollar company, and it's as much about networking as it is about GPUs.