3 ms·

Unfortunately that's how tech and media works. OpenAI itself was lucky as well. Before the LLM success, they were just another research lab that did the same st

Unfortunately that's how tech and media works. OpenAI itself was lucky as well. Before the LLM success, they were just another research lab that did the same stuff as everyone else and were mostly focused on RL. A few researchers randomly stumbled upon [0] the fact huge LLMs work unexpectedly well, but this might as well have happened at any other lab like Google or Meta because everyone was doing the same kind of research anyway. Anyone who is acting as if any of this was planned is just spinning a narrative. [0] https://news.ycombinator.com/item?id=34754355 https://news.ycombinator.com/item?id=34754355

p1esk 4y ago
they were just another research lab They have been a top-3 AI lab right from the start. A few researchers randomly stumbled upon [0] the fact huge LLMs work unexpectedly well No. Early on Sutskever said he believed they can get to AGI by simply scaling up models. Yes, everyone was doing similar research but OpenAI has been consistently first to show groundbreaking results. GPT 1-2-3, DALLe 1-2, CLIP, Jukebox - one of these could be considered luck, but all together points to greatness.