Wow, XLA has historically been absolute crap outside of TPUs and even for TPUs the error messages are incredibly poor. If nvidia actually wants to support XLA

Wow, XLA has historically been absolute crap outside of TPUs and even for TPUs the error messages are incredibly poor. If nvidia actually wants to support XLA now perhaps that means the TPU 5 is the last TPU, and/or future TPUs might be targeted at just inference and efficiency (like TPU 5) and then nvidia owns the training game. After all if you compare Nvidia’s success with H100 sales versus GCloud TPU sales, it would be easy for Sundar to say “if you can’t beat em join em” and just maintain TPU team for inference which is more closely tied to wall street margins.