This comparison makes 0 sense: You chose to compare TPUs to a Titan Xp, which is far from being the best ML GPU from NVIDIA and you are comparing it agains 4 T

This comparison makes 0 sense: You chose to compare TPUs to a Titan Xp, which is far from being the best ML GPU from NVIDIA and you are comparing it agains 4 TPUs. I invite you to check out the different benchmarks that were made comparing NVIDIA V100s againt TPUv2/v3: they all show that the performance are very similar, even slightly better for the V100 overall iirc. The only reason why TPUs are interesting is if you plan to rent an accelerator (that's also why Google doesn't sell them), you get around 50% savings for the same results using TPUs.