4 ms·
To me it's childish, and I have no idea why Yann decided this needed to be shouted on Twitter. I've lost a lot of respect for him over this.
by nightski 4y ago
To me it's childish, and I have no idea why Yann decided this needed to be shouted on Twitter. I've lost a lot of respect for him over this.
- arp242 4y agoAccording to the article: "LeCun made his remarks about OpenAI in response to a question during the colloquium posed by New York Times journalist Cade Metz. Metz asked if Meta's AI team, FAIR, which LeCun built, will ever be identified in the public mind with breakthroughs the way that OpenAI is." It seems to me "well actually, ChatGPT isn't really the breakthrough you think it is" is an appropriate response. He wasn't dismissive of ChatGPT and even praised it to some degree.
- nightski 4y agoHe's been tweeting quite a bit about it beyond what you referenced which was more what I was referring to.
- soperj 4y agoI think if you read the headline it seems childish. His main point is that Google/Meta couldn't really release this, since the accuracy is really really poor.
- cl42 4y agoIf that's true, then this is a beautiful example of creative destruction.
- visarga 4y agoWell, the transformer was invented at Google, language models were decades old. But scaling it was not done before, and preparing the dataset at this size, and babysitting the model so its loss doesn't explode during training - all were innovations that required lots of work and money to be achieved, so we can just copy the same formula without redoing all the steps.