3 ms·
Here's an important thing to keep in mind: GPT-3 was trained without any labelled data, just huge amounts of raw text. Nobody spent man-years annotating sentenc
by d_burfoot 6y ago
Here's an important thing to keep in mind: GPT-3 was trained without any labelled data, just huge amounts of raw text. Nobody spent man-years annotating sentences to help the system learn grammar, sentiment, topic understanding, etc.