5 ms·

Is this sort of thing reproducible? I must confess I'm sceptical of the idea that this was entirely produced by a machine.

by l0b0 6y ago

robertk 6y ago
The article references made up history like “GPT-1 by DeepMind” or “Global Data Net.” It is clearly confabulated and contains multiple non-sensical contradictions to the astute observer. I’m not surprised if it was output by GPT-3. A more lengthy response to your reaction is here: https://www.google.com/amp/s/srconstantin.wordpress.com/2019/02/25/humans-who-are-not-concentrating-are-not-general-intelligences/amp/ https://www.google.com/amp/s/srconstantin.wordpress.com/2019...
- l0b0 6y ago
  I'm not saying it was factually correct or internally consistent, just that it's miles ahead of any computer-generated text I've seen elsewhere.
  - robertk 6y ago
    Really? I thought it was in the same class as this one: https://amp.reddit.com/r/slatestarcodex/comments/hmu5lm/fiction_by_neil_gaiman_and_terry_pratchett_by_gpt3/ https://amp.reddit.com/r/slatestarcodex/comments/hmu5lm/fict... As well as multiple examples given by gwern.
  - bdamm 6y ago
    It's certainly miles ahead of where I thought we were at. Today's GPT-3 discussion (in this thread and elsewhere) have really opened up my concept of what is possible today. And I'm starting to wonder how many news articles are just basically GPT-3. Or really, how many people are earning good money doing less work than GTP-3 could do in an instant.
  - cortesoft 6y ago
    This is why everyone is talking about GPT-3
dougmwne 6y ago
I get a different output each time. Here is attempt #3 on the same prompt. Attempt #2 produced gibberish. https://pastebin.com/zTNu7Faa https://pastebin.com/zTNu7Faa Is that a joke at the end? I'm loosing perspective.
- minimaxir 6y ago
  The only way to get the same output each time is to set the temperature to 0 (which I don't think you can do in AI Dungeon)
- mensetmanusman 6y ago
  Interesting bit about God at the end (it makes the reddit mistake of thinking about God as a ‘being among beings’ though, so you get a sense of the data set it was trained on). It reminded me of child super-prodigies that get lost in thoughts about death: https://www.afr.com/work-and-careers/leaders/the-curse-of-being-a-child-genius-20190522-p51pyu https://www.afr.com/work-and-careers/leaders/the-curse-of-be...
  - bawolff 6y ago
    Is being among being wrong? There's a lot of religions with varying notions of the divine, but the divine as personified into a single q-like entity seems to be a pretty common conception, and not just in reddit. For that matter, if whichever deity you believe in is good, all powerful and all knowing, why is there still evil & pain in the world, is probably one of the most common criticisms of religion, and not just on reddit. And that seems to be roughly the criticism gpt-3 is making.
    - mensetmanusman 6y ago
      Some background: https://www.nwcatholic.org/voices/commentary/who-god-is-and-is-not.html https://www.nwcatholic.org/voices/commentary/who-god-is-and-...
      - bawolff 6y ago

Is this sort of thing reproducible? I must confess I'm sceptical of the idea that this was entirely produced by a machine.

by l0b0 6y ago

Is this sort of thing reproducible? I must confess I'm sceptical of the idea that this was entirely produced by a machine.

robertk 6y ago

The article references made up history like “GPT-1 by DeepMind” or “Global Data Net.” It is clearly confabulated and contains multiple non-sensical contradictions to the astute observer. I’m not surprised if it was output by GPT-3. A more lengthy response to your reaction is here: https://www.google.com/amp/s/srconstantin.wordpress.com/2019/02/25/humans-who-are-not-concentrating-are-not-general-intelligences/amp/ https://www.google.com/amp/s/srconstantin.wordpress.com/2019...

l0b0 6y ago
I'm not saying it was factually correct or internally consistent, just that it's miles ahead of any computer-generated text I've seen elsewhere.
- robertk 6y ago
  Really? I thought it was in the same class as this one: https://amp.reddit.com/r/slatestarcodex/comments/hmu5lm/fiction_by_neil_gaiman_and_terry_pratchett_by_gpt3/ https://amp.reddit.com/r/slatestarcodex/comments/hmu5lm/fict... As well as multiple examples given by gwern.
- bdamm 6y ago
  It's certainly miles ahead of where I thought we were at. Today's GPT-3 discussion (in this thread and elsewhere) have really opened up my concept of what is possible today. And I'm starting to wonder how many news articles are just basically GPT-3. Or really, how many people are earning good money doing less work than GTP-3 could do in an instant.
- cortesoft 6y ago
  This is why everyone is talking about GPT-3

dougmwne 6y ago

I get a different output each time. Here is attempt #3 on the same prompt. Attempt #2 produced gibberish. https://pastebin.com/zTNu7Faa https://pastebin.com/zTNu7Faa Is that a joke at the end? I'm loosing perspective.

minimaxir 6y ago
The only way to get the same output each time is to set the temperature to 0 (which I don't think you can do in AI Dungeon)
mensetmanusman 6y ago
Interesting bit about God at the end (it makes the reddit mistake of thinking about God as a ‘being among beings’ though, so you get a sense of the data set it was trained on). It reminded me of child super-prodigies that get lost in thoughts about death: https://www.afr.com/work-and-careers/leaders/the-curse-of-being-a-child-genius-20190522-p51pyu https://www.afr.com/work-and-careers/leaders/the-curse-of-be...
- bawolff 6y ago
  Is being among being wrong? There's a lot of religions with varying notions of the divine, but the divine as personified into a single q-like entity seems to be a pretty common conception, and not just in reddit. For that matter, if whichever deity you believe in is good, all powerful and all knowing, why is there still evil & pain in the world, is probably one of the most common criticisms of religion, and not just on reddit. And that seems to be roughly the criticism gpt-3 is making.
  - mensetmanusman 6y ago
    Some background: https://www.nwcatholic.org/voices/commentary/who-god-is-and-is-not.html https://www.nwcatholic.org/voices/commentary/who-god-is-and-...
    - bawolff 6y ago