3 ms·
ChatGPT is build on GPT-3. GPT-3 was a big NLP development. The paper has 7000+ citations: https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165 It
by cl42 4y ago
ChatGPT is build on GPT-3. GPT-3 was a big NLP development. The paper has 7000+ citations: https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165 It was a big deal in the NLP space.
It wasn't a 'cosmetic' improvement over existing NLP approaches.
- belval 4y agoRespectfully I don't think you read my comment. GPT3 != ChatGPT. ChatGPT is built on GPT-3 and is not breaking new ground. GPT3 is 3 years old and was breaking new ground in 2020 but Meta/Google/DeepMind all have LLM of their own which could be turned into a Chat-Something. That's the point LeCunn is making. He's not out there negating that the paper you linked was ground-breaking, he's saying that converting that model into ChatGPT was not ground-breaking from an academic standpoint.
- cl42 4y ago@belval -- sorry, can't reply directly. I understand what you're saying -- fair enough! I appreciate the clarification.