3 ms·
Do you think Microsoft would have a competitive foundational model if not for OpenAI? Cause Google and Meta seem like they’re top of the pack there, with AWS a
by VirusNewbie 3y ago
Do you think Microsoft would have a competitive foundational model if not for OpenAI? Cause Google and Meta seem like they’re top of the pack there, with AWS at the very least releasing some.
- vitorgrs 3y agoMicrosoft already had competitive models, especially Megatron-Turing. They were even using on Bing Chat before... I'm pretty sure they still use their model on Bing Chat today (Balanced mode). It was a competitive model for the time, it was made in 2021 if I recall in cooperation with Nvidia. The largest model at the time (and still remains one of the largest models ever made). https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/ https://developer.nvidia.com/blog/using-deepspeed-and-megatr... The thing here is that OpenAI managed to create GPT4 - that no one matched yet.
- hughesjj 3y agoYup, I took remember taydolf swiftler from way back when. Hey even if it didn't pan out, it still shows they'vd been trying and innovating for a while Similar for Cortana. Now, I don't like any of those products, but, still, effort is seen.