4 ms·
More generally, the best commentary I've seen on GPT-3 comes from following @gwern and keeping an eye out for whoever else they frequently interact with. https
by andyljones 6y ago
More generally, the best commentary I've seen on GPT-3 comes from following @gwern and keeping an eye out for whoever else they frequently interact with.
https://twitter.com/gwern/with_replies https://twitter.com/gwern/with_replies
Most other commentary I've seen either goes too far into reactionary skepticism, too far into to-the-moon style hype, or just straight-up gets stuff wrong by not being aware of some technical detail (importance of prompt design, BPE limits).
- ralfd 6y agoAt least it is witty: Andrej Karpathy @karpathy > By posting GPT generated text we’re polluting the data for its future versions John Carmack @ID_AA_Carmack > Was just about to say that... Old printed books will be the equivalent of the sunken ships they cut up for uncontaminated steel today.
- perl4ever 6y ago>Old printed books will be the equivalent of the sunken ships they cut up for uncontaminated steel today Already are.
- jobigoud 6y agoWhat are modern books contaminated with?
- dejj 6y ago> Old printed books will be the equivalent of the sunken ships they cut up for uncontaminated steel today. It's not so much contamination, but value drift. Did you ever try reading Shakespeare without commentary? So many things of that language are no longer colloquial. Maybe generated text can recover that and train us. Or imagine the "dark tongue" from Paul Kingsnorth' "The Wake" to have been real: we've come quite a bit in expressiveness.