4 ms·
Is this analogous to gtp-3 reading every sentence ever written without attribution to all of mankind?
by mensetmanusman 5y ago
Is this analogous to gtp-3 reading every sentence ever written without attribution to all of mankind?
- wizzwizz4 5y agoA little. But all works output by GPT-3 are provided in “source form” to everyone who uses them – whereas lots of the output of Co-Pilot (trained on copyleft code, among other things) is going into proprietary software projects. (Also, GPT-3 wasn't trained on nearly as much writing as that. Even if you ignore lost writing, GPT-3 was trained on a small subset of the 'net.)