Microsoft already had competitive models, especially Megatron-Turing. They were even using on Bing Chat before... I'm pretty sure they still use their model on

Microsoft already had competitive models, especially Megatron-Turing. They were even using on Bing Chat before... I'm pretty sure they still use their model on Bing Chat today (Balanced mode). It was a competitive model for the time, it was made in 2021 if I recall in cooperation with Nvidia. The largest model at the time (and still remains one of the largest models ever made). https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/ https://developer.nvidia.com/blog/using-deepspeed-and-megatr... The thing here is that OpenAI managed to create GPT4 - that no one matched yet.