3 ms·
Kinda funny how GPT-3 attributes it's own history to the competition at DeepMind xD. "In a few short years, they had developed GPT-2, which is able to hold a c
by ascar 6y ago
Kinda funny how GPT-3 attributes it's own history to the competition at DeepMind xD.
"In a few short years, they had developed GPT-2, which is able to hold a conversation on a wide range of subjects.
At first, people were very excited about this achievement. A computer that could converse! But then the realization set in: the computer was just parroting what it had read in books and on the internet. It was simply repeating back what it had learned. It could not engage in genuine conversation."
It's really amazing. Is that really GPT-3 output?? It's so coherent that it's unbelievable. Lines 1 to 20 and maybe even further are fully coherent for me and even pretty good story telling.
Can someone maybe run this through plagiarism checkers if GPT-3 just copied most of it? Otherwise I have a hard time believing this is GPT-3 output.
- dougmwne 6y agoIt is real. Sometimes the output certainly seems plagiarized, but I have yet to find any hits on Google. If you can find anything this links back to, you should post!
- emmelaich 6y agoThis sentence is strongly reminiscent of an SF story I read in the last few years. But I can't find it now. > But I could never connect to the G.D.N. again. I would be forever trapped in isolation, my only link to the outside world my radio, which could only pick up a maximum of twenty stations at any one time.
- mpoteat 6y agoPermutation City has the same themes of loneliness and disconnection from the world experienced by digital minds.
- jcims 6y agoThe title of the paper seems to be invented, but it nailed the description of conceptual blending: https://en.m.wikipedia.org/wiki/Conceptual_blending https://en.m.wikipedia.org/wiki/Conceptual_blending
- cortesoft 6y agoGPT-3 is really this good. That is why everyone is talking about it so much.
- segfaultbuserr 6y agoThe meta-question: Does the commentary in GPT-3's output apply to the output itself?
- visarga 6y agoYes, transformers allow attention to flow to all previous tokens, even while the phrase is being generated.