It's also worth mentioning that google spent a lot of time (and probably money) and human capital on their TPUs and slowly got there. Other companies that have

It's also worth mentioning that google spent a lot of time (and probably money) and human capital on their TPUs and slowly got there. Other companies that have a proven track record of hyper-scaling also tried and missed (tesla) so it's not as easy as locking a bunch of phds in a room and have them crank out LLMs. Hardware is finicky, slow to develop, slow to prove itself and extremely expensive.