4 ms·

I could tell this was GPT-3 because it reads like SEO-style sentence structure :/ > I imagine that similar results can be obtained by republishing GPT-3’s outp

I could tell this was GPT-3 because it reads like SEO-style sentence structure :/ > I imagine that similar results can be obtained by republishing GPT-3’s outputs to other message boards, blogs, and social media. I actually wrote a bit about this scenario and how it could explode comment sections to stonewall topics, which I'm calling Commentdämmerung: https://simonsarris.com/commentdammerung https://simonsarris.com/commentdammerung Still, I think a lot of people have been misled with respect to the coherence of GPT-3. It becomes especially clear once you stop looking at highlight reels (aka human curated gpt-3). The cherry picking changes the game of how compelling it seems vs how it really is. The author even does this: > I generated different results a couple (less than 10) times until I felt the writing style somewhat matched my own You can't yet claim to have a magic die if you keep rolling it until you get the answer you want!

exolymph 6y ago
Have you tried cowriting with it? Incredible for first drafts.
- sgibat 6y ago
  What's that process like? How do you use it when writing drafts?
  - exolymph 6y ago
    I intentionally didn't participate super actively in this demo, but it should still give you the idea: https://www.youtube.com/watch?v=rZZ_gDjGkzM https://www.youtube.com/watch?v=rZZ_gDjGkzM
visarga 6y ago
> You can't yet claim to have a magic die if you keep rolling it until you get the answer you want! The infinite monkey theorem states that a monkey hitting keys at random on a typewriter keyboard for an infinite amount of time will almost surely type any given text, such as the complete works of William Shakespeare. But here it was just 10 tries, not infinite.
shostack 6y ago
I share these concerns and wonder how much of its opening salvos we've already witnessed on Reddit and elsewhere. One of the tactics I've observed is generating passable quality noise between accounts to push actual important info and links in threads down. The lower they get pushed, and the more low quality the discourse in a comments section appears, the lower likelihood of people getting important information or seeing evidence of something being fake news. I suspect we'll see this in full effect sooner rather than later with the election upon us on the US. Can something be trained to detect gpt-3 and things like it?
MauranKilom 6y ago
Every time an article talks about training/finetuning/improving GPT-3, you know it's GPT-3 talking about itself. There's no option to do those things for GPT-3 outside of OpenAI. More broadly, you can be very sure that a text about GPT-3 originated from GPT-3 if it makes more sense when you replace "GPT-3" by "GPT-2" everywhere. GPT-3 naturally has no knowledge of itself because all related text was written after its training. The closest is GPT-2 (for which there is apparently plenty of corpus to sample from), so that's the content that GPT-3 writes about when forced to talk about itself.
ta_9c6abeb5 6y ago
What a beautiful thing is your website. I haven't felt this joy opening a page in ages.
- chrisjarvis 6y ago
  I was thinking the same thing until those animated dots continued to fly around the screen while I was trying to read the words. A strange design choice...

exolymph 6y ago

Have you tried cowriting with it? Incredible for first drafts.

sgibat 6y ago
What's that process like? How do you use it when writing drafts?
- exolymph 6y ago
  I intentionally didn't participate super actively in this demo, but it should still give you the idea: https://www.youtube.com/watch?v=rZZ_gDjGkzM https://www.youtube.com/watch?v=rZZ_gDjGkzM

visarga 6y ago

> You can't yet claim to have a magic die if you keep rolling it until you get the answer you want! The infinite monkey theorem states that a monkey hitting keys at random on a typewriter keyboard for an infinite amount of time will almost surely type any given text, such as the complete works of William Shakespeare. But here it was just 10 tries, not infinite.

shostack 6y ago

I share these concerns and wonder how much of its opening salvos we've already witnessed on Reddit and elsewhere. One of the tactics I've observed is generating passable quality noise between accounts to push actual important info and links in threads down. The lower they get pushed, and the more low quality the discourse in a comments section appears, the lower likelihood of people getting important information or seeing evidence of something being fake news. I suspect we'll see this in full effect sooner rather than later with the election upon us on the US. Can something be trained to detect gpt-3 and things like it?

MauranKilom 6y ago

Every time an article talks about training/finetuning/improving GPT-3, you know it's GPT-3 talking about itself. There's no option to do those things for GPT-3 outside of OpenAI. More broadly, you can be very sure that a text about GPT-3 originated from GPT-3 if it makes more sense when you replace "GPT-3" by "GPT-2" everywhere. GPT-3 naturally has no knowledge of itself because all related text was written after its training. The closest is GPT-2 (for which there is apparently plenty of corpus to sample from), so that's the content that GPT-3 writes about when forced to talk about itself.

ta_9c6abeb5 6y ago

What a beautiful thing is your website. I haven't felt this joy opening a page in ages.

chrisjarvis 6y ago
I was thinking the same thing until those animated dots continued to fly around the screen while I was trying to read the words. A strange design choice...