OpenAI has not invented much of any new ideas. None of them worked on transformers, or diffusion or a host of other technologies that power their models. (thoug

OpenAI has not invented much of any new ideas. None of them worked on transformers, or diffusion or a host of other technologies that power their models. (though one of the leads at OpenAI built PPO while in his PhD). But they’ve perfected the art of training and deploying models, which I think is their moat. It still shocks me that their speech recognition model is miles ahead of Siri (that struggles heavily with my accent) and even Alexa. How is it that 2 companies that have invested billions of dollars into these products, end up with worse results than a small team in startup whose main focus isn’t speech recognition? Almost like how Toyota didn’t invent the car, but perfected the art of building reliable cars, I see OpenAI as perfecting the art of the building ML models that just work in the real world