4 ms·

Wait, are you really saying that all of this was generated by GPT-3? I mean, it seems like that's pretty clearly what you're saying, but these results are so in

by johnfn 6y ago

Wait, are you really saying that all of this was generated by GPT-3? I mean, it seems like that's pretty clearly what you're saying, but these results are so incredibly good that I almost can't believe it. It's astounding to me that GPT-3 could generate something like "I don't know what you mean by "no legs," so I'll just pick something with four legs." EDIT: Yeah, that's clearly what you're saying. You should write this up; it's amazing.

skybrian 6y ago
These are most likely the best, cherry-picked results. Sharing the boring failures is no fun.
- kolinko 6y ago
  Did you play with gpt-3? It is seriously that good. Has it’s worse moments and limitations, but I have no problem believing this was done like this on a first try.
  - cmrdsprklpny 6y ago
    How do you get access to GPT-3? Is there a way besides signing up for the openai api?
    - ReC757 6y ago
      The paid "dragon" model of https://play.aidungeon.io/ https://play.aidungeon.io/ is a great way to tinker with a modified version of the model. I believe there is still a trial. I suggest making a custom prompt. Have the prompt be something to the extent of "you are a programmer with a computer that answers your questions" and things like "this room has no doors and nobody comes in or out. Input: What is the command to list hidden files in a directory? Output: ls -a Input:" It's a great way to get an idea of how it works until the API access goes through. Edit: Turn the "Randomness" slider down and adjust the amount of words to output for results to your liking!
      - ASVVVAD 6y ago
        That's really amazing, thanks! It's almost unbelievable
  - skybrian 6y ago
    Yes, via AI Dungeon. The results are often quite good and I have no trouble believing those were actual results. But they aren't always good and I also know how easy it is to undo a bad result and try again, with a single mouse click. The transcript doesn't save the mistakes.
- blixt 6y ago
  Yup this is for sure not all the outputs, but these are all in sequence, so it's able to output this quality consistently. It's just really good at generating human-like output. I posted a link to a Gist with full playground file in one of the other comments here, that included both my seed prompts at the top and then all the OpenAI answers below. Regardless, maybe I or someone else can create a post with a random set of questions / answers to show a more unbiased view of the GPT-3 outputs.
  - ndm000 6y ago
    Have you tried giving it a problem and having it come up with questions that you you answer? Given it’s clearly making assumptions and conclusions, it would be so interesting to play 20 questions with it. Something like... I’m thinking of an animal. Will GPT-3 start general and get to an answer?
    - blixt 6y ago
      I actually did this and while it follows the conversation quite well I think it’s really hard to make the argument that there was a decision early in the text what animal it thought of. That would only be possible if there were hidden embeddings in the output but that’s not possible after the output is converted into text. And I’m not sure how you’d prove that an animal was embedded in earlier layers since it’s pretty hard to inspect these neural networks.

by johnfn 6y ago

skybrian 6y ago

These are most likely the best, cherry-picked results. Sharing the boring failures is no fun.

kolinko 6y ago
Did you play with gpt-3? It is seriously that good. Has it’s worse moments and limitations, but I have no problem believing this was done like this on a first try.
- cmrdsprklpny 6y ago
  How do you get access to GPT-3? Is there a way besides signing up for the openai api?
  - ReC757 6y ago
    The paid "dragon" model of https://play.aidungeon.io/ https://play.aidungeon.io/ is a great way to tinker with a modified version of the model. I believe there is still a trial. I suggest making a custom prompt. Have the prompt be something to the extent of "you are a programmer with a computer that answers your questions" and things like "this room has no doors and nobody comes in or out. Input: What is the command to list hidden files in a directory? Output: ls -a Input:" It's a great way to get an idea of how it works until the API access goes through. Edit: Turn the "Randomness" slider down and adjust the amount of words to output for results to your liking!
    - ASVVVAD 6y ago
      That's really amazing, thanks! It's almost unbelievable
- skybrian 6y ago
  Yes, via AI Dungeon. The results are often quite good and I have no trouble believing those were actual results. But they aren't always good and I also know how easy it is to undo a bad result and try again, with a single mouse click. The transcript doesn't save the mistakes.
blixt 6y ago
Yup this is for sure not all the outputs, but these are all in sequence, so it's able to output this quality consistently. It's just really good at generating human-like output. I posted a link to a Gist with full playground file in one of the other comments here, that included both my seed prompts at the top and then all the OpenAI answers below. Regardless, maybe I or someone else can create a post with a random set of questions / answers to show a more unbiased view of the GPT-3 outputs.
- ndm000 6y ago
  Have you tried giving it a problem and having it come up with questions that you you answer? Given it’s clearly making assumptions and conclusions, it would be so interesting to play 20 questions with it. Something like... I’m thinking of an animal. Will GPT-3 start general and get to an answer?
  - blixt 6y ago
    I actually did this and while it follows the conversation quite well I think it’s really hard to make the argument that there was a decision early in the text what animal it thought of. That would only be possible if there were hidden embeddings in the output but that’s not possible after the output is converted into text. And I’m not sure how you’d prove that an animal was embedded in earlier layers since it’s pretty hard to inspect these neural networks.