Google is generous for giving TPU for free for research, so likely it is using this. The more representative number is one from meta which required 87k A100 hou

Google is generous for giving TPU for free for research, so likely it is using this. The more representative number is one from meta which required 87k A100 hours, which is close to $100-200k for 7B model training.