Seems to align with Google, seems like they release a new TPU every 1.5 to 2 years. I think modern LLMs are powerful enough now that they will still be useful

Seems to align with Google, seems like they release a new TPU every 1.5 to 2 years. I think modern LLMs are powerful enough now that they will still be useful in a couple years even if they aren't state-of-the-art. ChatGPT still lets you run their older model for cheaper than running GPT4, I could see a world where GPT4 is still available in 1.5 years even if there are better models out there.