FWIW, you can stream at 10Gbps to TPUs. (I've done it.) 10Gbps isn't quite 40Gbps, but I think you can get there by streaming to a few different TPUs on differ

FWIW, you can stream at 10Gbps to TPUs. (I've done it.) 10Gbps isn't quite 40Gbps, but I think you can get there by streaming to a few different TPUs on different VPC networks. Or to the same TPU from different VMs, possibly. The point is that there's a realistic alternative to nVidia's monopoly.