5 ms·

I'm on the "if you can't tell the difference..." side, too, but the issue is the "10 tries" and the prompting. GPT-3 has no ability to revise or reconsider or j

I'm on the "if you can't tell the difference..." side, too, but the issue is the "10 tries" and the prompting. GPT-3 has no ability to revise or reconsider or judge anything it writes. We're still safe, IMO, until the main loop goes >generate 10 "netcan comments" >drop 5 least conformant results >reword remaining comments several times >reassess rewordings, select best of each set >select 1 most conformant "netcan comment" Right now (AFAIK, anyway) all GPT-3 does is the first one. Think about how a human is creative -- lots of drafts, lots of dead ends, lots of borrowing, lots of revision. I appreciate that "reflection on its own output" is waaaay out of scope for a glorified, omni-contextual Markov chain, but I think we're safe, both from the threat of GPT-3 being "creative" in the same way we are (and therefore, maybe "alive" in the same way we are) and the threat of our own mental processes being revealed to be as merely computational as those of GPT-3.

netcan 5y ago
Oh I don't disagree that the "best of gpt-3" on twitter is automated hyperbole machine.^ But I think at least in HN, a lot of people have looked at somewhat more objective sources too. The standard way to prove a trick shot is to film yourself do two or three in a row. I agree these are tricks, and a lot are unproven. Some are proven though, FWIW. Anyway, if the damn thing can do me 10%-60% of the time in a non trivial context... IDK, maybe this just becomes the default standard for "non trivial." and it's no big deal. It is disconcerting though. In any case, assuming GPT-3 progresses... there might be uses for software that does just the first of those things. All my above comment really means for sure is that NLP can now participate, simulate and perhaps instigate flame wars better. Flame wars were always one of the easy targets, so that's not much of a standard. Who knows though, maybe the road to AGI is a gradual refinement of a flamewar bot to a dialectic philosopher. Cheating on essays is gonna start getting fun. ^If a person uses the Tom Sawyer fence trick to automate a task, is that automation? If the machine does it, is the turn tables?
- revolvingocelot 5y ago
  Absolutely. The "problem" essentially goes away with a cyborg approach: let GPT-3 generate its 10 netcan comments, then have a human do a little refining, maybe reframe the prompt, edit the result a little, and bam! Much scarier! Not that a sufficiently determined human couldn't ape someone's comment style, but GPT-3 is a force multiplier in the same way that sockpuppet management software is for the professional sockpuppeteer -- scales better, more effective, just makes everything easier. I've heard serious speculation that GPT-3 (or certainly its successors) might find utility for writers as a combination of a ghostwriter and Github Copilot. >^If a person uses the Tom Sawyer fence trick to automate a task, is that automation? If the machine does it, is the turn tables? It's not here yet, but the grim day on which I no longer communicate with anyone on the Internet for fear they're not actually a living conversational partner approaches. Even those I can cryptographically prove are people that I know will be suspects: "euurgh, I'm too busy to talk to this guy today, he's so boring. I'll just feed GPT-10 all our old conversations, tell it to be me, aaaand..."
  - netcan 5y ago
    Messaging apps already do a bare version of suggesting auto-replies. It's mostly it's a texting-while-driving aid, so they keep it concise and uncomplicated. Code completion already exists. Spam. Gradual steps have places to start stepping.
- tremon 5y ago
  the "best of gpt-3" on twitter is automated hyperbole machine Isn't that step 4 in the GP's scary loop? Having the humans do the assessing, then select the best by counting the number of likes/retweets?
hooande 5y ago
this is the only way to reliably use GPT-X in a production setting. you have to postprocesses the responses with a second model, until you find one that is 1) reasonable 2) coherent 3) related to the topic of the prompt

netcan 5y ago

Oh I don't disagree that the "best of gpt-3" on twitter is automated hyperbole machine.^ But I think at least in HN, a lot of people have looked at somewhat more objective sources too. The standard way to prove a trick shot is to film yourself do two or three in a row. I agree these are tricks, and a lot are unproven. Some are proven though, FWIW. Anyway, if the damn thing can do me 10%-60% of the time in a non trivial context... IDK, maybe this just becomes the default standard for "non trivial." and it's no big deal. It is disconcerting though. In any case, assuming GPT-3 progresses... there might be uses for software that does just the first of those things. All my above comment really means for sure is that NLP can now participate, simulate and perhaps instigate flame wars better. Flame wars were always one of the easy targets, so that's not much of a standard. Who knows though, maybe the road to AGI is a gradual refinement of a flamewar bot to a dialectic philosopher. Cheating on essays is gonna start getting fun. ^If a person uses the Tom Sawyer fence trick to automate a task, is that automation? If the machine does it, is the turn tables?

revolvingocelot 5y ago
Absolutely. The "problem" essentially goes away with a cyborg approach: let GPT-3 generate its 10 netcan comments, then have a human do a little refining, maybe reframe the prompt, edit the result a little, and bam! Much scarier! Not that a sufficiently determined human couldn't ape someone's comment style, but GPT-3 is a force multiplier in the same way that sockpuppet management software is for the professional sockpuppeteer -- scales better, more effective, just makes everything easier. I've heard serious speculation that GPT-3 (or certainly its successors) might find utility for writers as a combination of a ghostwriter and Github Copilot. >^If a person uses the Tom Sawyer fence trick to automate a task, is that automation? If the machine does it, is the turn tables? It's not here yet, but the grim day on which I no longer communicate with anyone on the Internet for fear they're not actually a living conversational partner approaches. Even those I can cryptographically prove are people that I know will be suspects: "euurgh, I'm too busy to talk to this guy today, he's so boring. I'll just feed GPT-10 all our old conversations, tell it to be me, aaaand..."
- netcan 5y ago
  Messaging apps already do a bare version of suggesting auto-replies. It's mostly it's a texting-while-driving aid, so they keep it concise and uncomplicated. Code completion already exists. Spam. Gradual steps have places to start stepping.
tremon 5y ago
the "best of gpt-3" on twitter is automated hyperbole machine Isn't that step 4 in the GP's scary loop? Having the humans do the assessing, then select the best by counting the number of likes/retweets?

hooande 5y ago

this is the only way to reliably use GPT-X in a production setting. you have to postprocesses the responses with a second model, until you find one that is 1) reasonable 2) coherent 3) related to the topic of the prompt