While that may be true, the opposite has also happened to hundreds of companies in other areas: https://news.ycombinator.com/item?id=39136472 https://news.ycom

While that may be true, the opposite has also happened to hundreds of companies in other areas: https://news.ycombinator.com/item?id=39136472 https://news.ycombinator.com/item?id=39136472 Many companies also optimize for tools, like Python, that have boost productivity more than price/performance ratio. OpenAI had billions of other people's money. They might just keep using tools which worked before. Lastly, there are tons of papers published on techniques that claim to reduce cost. Most of them aren't good. Their benchmarks aren't good. Even reviewing most of them is more time than a lot of AI researchers have. Those that make it to established communities usually have gotchas that come with the benefits. So, they could also simply miss a needle in a large haystack. I think you're right that they'd be using whatever really worked with no loss in model performance. It's just that they might not for a number of reasons. The rational choice is for others to keep experimenting with those things in case they get a competitive advantage.