3 ms·
I am more excited about this in some ways than GPT-3. GPT-3 is amazing, but I can actually use a small high performing model.
by teruakohatu 6y ago
I am more excited about this in some ways than GPT-3. GPT-3 is amazing, but I can actually use a small high performing model.
- polymorph1sm 6y agoI recently found this paper[1] claiming near GPT-3 performance with only a fraction of parameters. They seems to simply reformulate the input sequence to change classification to a sequence generation task. Disclaimer, I am not affiliated to any of the authors [1] https://arxiv.org/pdf/2009.07118.pdf https://arxiv.org/pdf/2009.07118.pdf