3 ms·
This is changing. In natural language processing just in the past couple weeks OpenAI wrote about their GPT3 model which can learn some tasks remarkably quickl
by SomewhatLikely 6y ago
This is changing. In natural language processing just in the past couple weeks OpenAI wrote about their GPT3 model which can learn some tasks remarkably quickly, after only 1 or 2 examples. That model has extreme compute requirements, but it shows strong progress on performing never before seen tasks. There is still some steam left in the current deep learning boom.
https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165
- ausbah 6y agoI heard someone theorize that GPT3 can perform so well simply because it can overfit to every domain