3 ms·
What a weird article. Semi-supervised training is always interesting, but leading with fact that it outperforms GPT-3 on superGLUE in the few shot setting wher
by nl 6y ago
What a weird article.
Semi-supervised training is always interesting, but leading with fact that it outperforms GPT-3 on superGLUE in the few shot setting where GPT-3 isn't training/fine-tuning but PET is.
To make it clear: they finetune PET using synthetic data and then compare the results of this to GPT-3 where GPT-3 is initalized to prepare for querying.
I would like to see how much overlap the synthetic data has with the queries used.