3 ms·
After trying a few to get a handle on things, I decided to make guesses based solely on if the sentence makes coherent sense. I judged 14 quotes before getting
by c3534l 6y ago
After trying a few to get a handle on things, I decided to make guesses based solely on if the sentence makes coherent sense. I judged 14 quotes before getting a repeat, having gotten 13 wrong and only 1 right.
Now, if it was 50/50, I'd have said they're just as coherent. But it's 13:1 which suggests to me that there is a bias here. I think the authors intentionally selected quotes which make the least sense out of context to be the Goop quotes and cherry picked GPT2 quotes that happened to sound the most sense without any context. This is supported by the fact that I only had to go through 14 quotes before it started repeating.
If that's the case, and I suspect it is, it's not really dishonest per se, but it is at least sensationalist and potentially misleading. It's asking you to draw conclusions by having you participate in an experiment where it has its thumb on the scales.
- woah 6y agoHeavy curation is unfortunately rampant in the genre of "wow check out this AI"
- quickthrower2 6y agoThat’s what my bot said.
- craftinator 6y agoBe nice, feelings that bots have too.
- minimaxir 6y agoThere's no issue with heavy curation as long as it's disclosed.
- arcturus17 6y agoI got 8:2 in my favor... It might have been luck but I think I could tell the signs of the machine-written bits. Sometimes it was a small grammatical detail that I thought a pro writer would take into account, other times when it was inference on content, where I did not think Goop would write about that.
- deleted 6y ago[deleted]
- avianlyric 6y agoLooking at the site, and the authors comment, this looks like a quick weekend project made for fun. I wouldn’t spend too much time reading into it or critiquing it’s honesty. It clear the author is just making fun of Goop through the medium of AI. Making out as anything more than that would be like critiquing The Onion for not providing sources.
- deleted 6y ago[deleted]
- zests 6y agoI'd imagine that if you didn't know the text might be written by AI you wouldn't recognize anything strange with it at all. I glance over typos and grammatical errors all the time. And then there's the the famous "the the" phenomenon.