4 ms·

For all the texts generated by GPT3, is anyone verifying that it's not just copy pasting paragraphs from previous seen texts? (like by, searching n-grams or eve

For all the texts generated by GPT3, is anyone verifying that it's not just copy pasting paragraphs from previous seen texts? (like by, searching n-grams or even just googling it?) If not, then its pretty easy for GPT-3 to copy paste existing human written texts and just prove that it can write like a human.

Ologn 6y ago
The question is, is this different from how humans learn to write and speak a particular language?
- Filligree 6y ago
  Yes. This time a machine is doing it, therefore it doesn't count as intelligence.
- probably_wrong 6y ago
  Simple example that's been around: if I train a model on a lot of Java source code, but I provide no example of the output of those programs, has this model learned how to program in Java? And is that how humans learn programming?
scoopertrooper 6y ago
> its pretty easy for GPT-3 to copy paste existing human written texts My god, they've finally worked out that humans haven't written anything original since the dawn of the internet.
paraschopra 6y ago
I've been playing with the generated text. It's usually NOT a direct copy-paste (verifying by searching on Google with the generated text in quotes)
- air7 6y ago
  I'd like to do that to. Any ideas on how to get access to it to play around?
mindhash 6y ago
It’s more like it picks words from autosuggest that you see on your mobile keypad but better
minimaxir 6y ago
For my GPT-3 tweets, I Google the ones that are too good to see if it's a dupe. Only 1/200 or so tweets that I checked had a verbatim dupe.
jcims 6y ago
I have quite a bit as I find some of what it generates to be rather profound. Sometimes it's a direct copy, but that's pretty rare. What does happen pretty regularly is that it reformulates existing content. So you'll see structure of an existing statement but with a different topic so the nounds and verbs are replaced. It's quite weird.
- mkagenius 6y ago
  Thats interesting. Its profound because it is profound, or because it replaced the nouns and verbs. Like, if you replace nouns of an existing sentences from a book on astronomy and use it in your regular conversation, wouldn't it sound profound? (like, saying to someone, hey one day you will explode like a supernova, but it will take time.)
  - jcims 6y ago
    I would say profound in that I've read some stuff from GPT-3 that, to borrow a phrase, 'hits different'. Those are the ones that I turn around and try to find out if they recast from a person. Gwern's poetry work is a good example. 90% of it is duh to meh, but there are little sparkles of genius in there. So the profundity comes first, and I can't always find an inspiration for it. With GPT-3 in particular, that would be the exception rather than the rule.

Ologn 6y ago

The question is, is this different from how humans learn to write and speak a particular language?

Filligree 6y ago
Yes. This time a machine is doing it, therefore it doesn't count as intelligence.
probably_wrong 6y ago
Simple example that's been around: if I train a model on a lot of Java source code, but I provide no example of the output of those programs, has this model learned how to program in Java? And is that how humans learn programming?

scoopertrooper 6y ago

> its pretty easy for GPT-3 to copy paste existing human written texts My god, they've finally worked out that humans haven't written anything original since the dawn of the internet.

paraschopra 6y ago

I've been playing with the generated text. It's usually NOT a direct copy-paste (verifying by searching on Google with the generated text in quotes)

air7 6y ago
I'd like to do that to. Any ideas on how to get access to it to play around?

mindhash 6y ago

It’s more like it picks words from autosuggest that you see on your mobile keypad but better

minimaxir 6y ago

For my GPT-3 tweets, I Google the ones that are too good to see if it's a dupe. Only 1/200 or so tweets that I checked had a verbatim dupe.

jcims 6y ago

I have quite a bit as I find some of what it generates to be rather profound. Sometimes it's a direct copy, but that's pretty rare. What does happen pretty regularly is that it reformulates existing content. So you'll see structure of an existing statement but with a different topic so the nounds and verbs are replaced. It's quite weird.

mkagenius 6y ago
Thats interesting. Its profound because it is profound, or because it replaced the nouns and verbs. Like, if you replace nouns of an existing sentences from a book on astronomy and use it in your regular conversation, wouldn't it sound profound? (like, saying to someone, hey one day you will explode like a supernova, but it will take time.)
- jcims 6y ago
  I would say profound in that I've read some stuff from GPT-3 that, to borrow a phrase, 'hits different'. Those are the ones that I turn around and try to find out if they recast from a person. Gwern's poetry work is a good example. 90% of it is duh to meh, but there are little sparkles of genius in there. So the profundity comes first, and I can't always find an inspiration for it. With GPT-3 in particular, that would be the exception rather than the rule.