5 ms·

I just gave it the opening paragraph of Pride & Prejudice in edit mode and the instruction to "rewrite it as a rap": When Jane saw mister Bingley, She

I just gave it the opening paragraph of Pride & Prejudice in edit mode and the instruction to "rewrite it as a rap": When Jane saw mister Bingley, She knew that he was fine, But it took her a while to realize He wanted to be more than friends, Then she met Fitzwilliam Darcy, And she thought he had a lot of money, But it took her a while to realize He didn't want to talk about money, She was just a young girl, But she knew what was going on, She knew who she wanted to be with, But she also had her doubts, She knew he was great, But she also thought he was a snob, She was afraid that, He was going to break her heart. She loved him, But didn't know if she could trust him, So she decided to wait, Until his feelings became clear. Then all of a sudden, She realized, That she had been waiting all this time, And that she was in love. So she decided to go after him, And she got to him just in time, And they lived happily ever after. It's a terrible rap but a fairly impressive summary of the book (from someone that's admittedly never read it) Odd that it took "rewrite (the opening paragraph) as a rap" to mean "summarise the whole book".

snek_case 5y ago
It might have memorized a summary of the book from the data it's been trained on. GPT-3 is impressive, but it's kind of hard to control exactly what it's going to do. It recognized what you input was from pride and prejudice, remembered a summary of the book from somewhere, and turned that into a rap, which is both impressive and not really what you asked for.
- oofbey 5y ago
  Deep learning theory has shown that these huge neural networks can memorize basically any dataset they're given. The useful ones find ways to interpolate everything they've memorized to new contexts.
  - arjvik 5y ago
    Not that it's easy to quantify, but do we know if the interpolation tends to happen at training time or inference time?
    - eru 5y ago
      Essentially anything that happens at inference time also happens at training time. Because training is largely running inference, and then correcting any mistakes. Over and over again. (I say largely, because inference also does stuff like sample top-k completions etc.)
  - CSSer 5y ago
    But they seem terrible at anticipating what people want or find entertaining, which is what a lot of human interaction and entertainment is about. GP wanted a rap but got a shitty poem.
    - gwern 5y ago
      Obligatory mention: GPT-3 cannot learn to rhyme, it can only brute-force memorize rhyme-pairs, because the BPE encoding erases phonetic information from the encoding of words that a GPT-3 (and similar models like Gopher or GPT-J or Jurassic-1) is trained on. https://www.gwern.net/GPT-3#bpes https://www.gwern.net/GPT-3#bpes This is why that rap looks so weird: so high-quality in general, yet so totally lacking a critical element we expect from rap. GPT-3 has a pretty good idea how to write rap, but it just doesn't know what words sound like. It is blind to that. It can't see that difference between rap and poems. To it, rap is just a sort of poetry, and some words are chosen for reasons it can't understand, no matter how many rap lyrics or poems it looks at. The better the models get at writing, the more this difference throws us for a loop: "how can it be so good at ABC, and yet fail so totally at D?"
      - TaylorAlexander 5y ago
        Interesting! So what I am hearing from this is that some day we will overcome this and have programs that can rap. And then companies with customer support bots will have a little check box if you want the bot to rap all responses to you.
        eru 5y ago
        Technically, we know exactly what we have to do to GPT-3 to give it a chance to learn how to rhyme: get rid of BPES and just use raw UTF-8 (or even just ASCII) as the encoding. Enlarge the model a bit, as necessary. At least that's what I am getting from Gwern's write-up. I might have misunderstood Gwern, or Gwern might be wrong, of course.
        PeterisP 5y ago

snek_case 5y ago

It might have memorized a summary of the book from the data it's been trained on. GPT-3 is impressive, but it's kind of hard to control exactly what it's going to do. It recognized what you input was from pride and prejudice, remembered a summary of the book from somewhere, and turned that into a rap, which is both impressive and not really what you asked for.

oofbey 5y ago
Deep learning theory has shown that these huge neural networks can memorize basically any dataset they're given. The useful ones find ways to interpolate everything they've memorized to new contexts.
- arjvik 5y ago
  Not that it's easy to quantify, but do we know if the interpolation tends to happen at training time or inference time?
  - eru 5y ago
    Essentially anything that happens at inference time also happens at training time. Because training is largely running inference, and then correcting any mistakes. Over and over again. (I say largely, because inference also does stuff like sample top-k completions etc.)
- CSSer 5y ago
  But they seem terrible at anticipating what people want or find entertaining, which is what a lot of human interaction and entertainment is about. GP wanted a rap but got a shitty poem.
  - gwern 5y ago
    Obligatory mention: GPT-3 cannot learn to rhyme, it can only brute-force memorize rhyme-pairs, because the BPE encoding erases phonetic information from the encoding of words that a GPT-3 (and similar models like Gopher or GPT-J or Jurassic-1) is trained on. https://www.gwern.net/GPT-3#bpes https://www.gwern.net/GPT-3#bpes This is why that rap looks so weird: so high-quality in general, yet so totally lacking a critical element we expect from rap. GPT-3 has a pretty good idea how to write rap, but it just doesn't know what words sound like. It is blind to that. It can't see that difference between rap and poems. To it, rap is just a sort of poetry, and some words are chosen for reasons it can't understand, no matter how many rap lyrics or poems it looks at. The better the models get at writing, the more this difference throws us for a loop: "how can it be so good at ABC, and yet fail so totally at D?"
    - TaylorAlexander 5y ago
      Interesting! So what I am hearing from this is that some day we will overcome this and have programs that can rap. And then companies with customer support bots will have a little check box if you want the bot to rap all responses to you.
      - eru 5y ago
        Technically, we know exactly what we have to do to GPT-3 to give it a chance to learn how to rhyme: get rid of BPES and just use raw UTF-8 (or even just ASCII) as the encoding. Enlarge the model a bit, as necessary. At least that's what I am getting from Gwern's write-up. I might have misunderstood Gwern, or Gwern might be wrong, of course.
        PeterisP 5y ago