3 ms·

That's amazing. The only problems I caught are that there's a spurious double quote right at the start, and Murphy seems to have two children, a son and a dau

by mkl 6y ago

That's amazing. The only problems I caught are that there's a spurious double quote right at the start, and Murphy seems to have two children, a son and a daughter, but then later refers to "the boys". To really evaluate these samples, we need a way to search for phrases in the training data, to see how much is just learned and copied. I've tried Google and DDG, but not found anything.

hyperman1 6y ago
I also wonder how much is invented, and how much is simply copied. I saw this one by GPT3 https://read-the-samples.netlify.app/sample_2007 https://read-the-samples.netlify.app/sample_2007 and compare it to e.g. https://www.bbc.com/news/world-europe-35869985 https://www.bbc.com/news/world-europe-35869985 GPT-3 has quite a lot of correct facts, manages to mix fouad belkacem and Sharia4Belgium into it, etc... I suspect this is what happens when there is not enough training data: You get a lookalike, not something new. To be clear: It's impressive what GPT-3 is capable of, and it's very probable something better is comming in the near future. (It's also quite amusing how a lot of these terrorists get first killed by the police and then thrown into jail for 20 years. That'll teach their corpses! )
- gomox 6y ago
  > I also wonder how much is invented, and how much is simply copied Well, the average human probably does not excel at this metric either
taneq 6y ago
I don't know much about these kinds of neural nets but this is the thing I've wondered about - with billions of parameters and enormous training sets, it seems more than likely that it's squirreled away fair chunks of text inside itself that it can regurgitate. Edit: I pasted the random sample above into Grammarly's plagiarism detector and it says it "detected plagiarism" but I'm not paying to sign up just to find out what it said (also they make you sign up with your email address before mentioning that it costs money... rude!) Maybe someone with a Grammarly subscription can try it? Edit 2: Getting off-topic but wow, Grammarly is a nest of dark patterns. Doesn't tell you you need to create an account until you've pasted your text in. Doesn't tell you you need to pay a subscription until you've created an account. Sends you a follow-up email a few minutes later if you don't subscribe. Puts the account deletion link in a different colour and location to the rest of the account settings so it looks like a footer. Swaps the styling for the 'delete account' and 'keep account' links when you do find the delete button to try and steer you away from deleting your account. After that lot I'm never giving them a cent.

by mkl 6y ago

hyperman1 6y ago

I also wonder how much is invented, and how much is simply copied. I saw this one by GPT3 https://read-the-samples.netlify.app/sample_2007 https://read-the-samples.netlify.app/sample_2007 and compare it to e.g. https://www.bbc.com/news/world-europe-35869985 https://www.bbc.com/news/world-europe-35869985 GPT-3 has quite a lot of correct facts, manages to mix fouad belkacem and Sharia4Belgium into it, etc... I suspect this is what happens when there is not enough training data: You get a lookalike, not something new. To be clear: It's impressive what GPT-3 is capable of, and it's very probable something better is comming in the near future. (It's also quite amusing how a lot of these terrorists get first killed by the police and then thrown into jail for 20 years. That'll teach their corpses! )

gomox 6y ago
> I also wonder how much is invented, and how much is simply copied Well, the average human probably does not excel at this metric either

taneq 6y ago

I don't know much about these kinds of neural nets but this is the thing I've wondered about - with billions of parameters and enormous training sets, it seems more than likely that it's squirreled away fair chunks of text inside itself that it can regurgitate. Edit: I pasted the random sample above into Grammarly's plagiarism detector and it says it "detected plagiarism" but I'm not paying to sign up just to find out what it said (also they make you sign up with your email address before mentioning that it costs money... rude!) Maybe someone with a Grammarly subscription can try it? Edit 2: Getting off-topic but wow, Grammarly is a nest of dark patterns. Doesn't tell you you need to create an account until you've pasted your text in. Doesn't tell you you need to pay a subscription until you've created an account. Sends you a follow-up email a few minutes later if you don't subscribe. Puts the account deletion link in a different colour and location to the rest of the account settings so it looks like a footer. Swaps the styling for the 'delete account' and 'keep account' links when you do find the delete button to try and steer you away from deleting your account. After that lot I'm never giving them a cent.