4 ms·

At least part of the ethics problem here is that it'd be plausible to conduct this research without creating any new posts. There's a huge volume of generative

At least part of the ethics problem here is that it'd be plausible to conduct this research without creating any new posts. There's a huge volume of generative AI content on Reddit already - and a meaningfully large %ge of it follows predictable patterns. Wildly divergent writing styles between posts, posting 24/7, posting multiple long-form comments in short time periods, usernames following a specific pattern, and dozens of other heuristics. It's not difficult to find this content on the site. Creating more of it seems like a redundant step in the research. It added little to the research, while creating very obvious ethical issues.

hdhdhsjsbdh 2y ago
That would be a very difficult study to design. How do you know with 100% certainty that any given post is AI-generated? If the account is tagged as a bot, then you aren’t measuring the effect of manipulation from comments presented as real. If you are trying to detect whether they are AI-generated, then any noise in your heuristic or model for detecting AI-generated comments is then baked into your results.
- OtherShrezzing 1y ago
  The study as conducted also suffers those weaknesses. The authors didn’t make any meaningful attempt to determine if their marks were human or bots. Given the prevalence of bots on Reddit, this seriously undermines the study’s findings.
photonthug 2y ago
> At least part of the ethics problem here is that it'd be plausible to conduct this research without creating any new posts. This is a good point. Arguably though if you want people to take the next cambridge analytica or similar as something serious from the very beginning, we need an arsenal of academic studies with results that are clearly applicable and very hard to ignore or dispute. So I can see the appeal of producing a paper abstract that's specifically "X% of people shift their opinions with minor exposure to targeted psyops LLMs".

hdhdhsjsbdh 2y ago

That would be a very difficult study to design. How do you know with 100% certainty that any given post is AI-generated? If the account is tagged as a bot, then you aren’t measuring the effect of manipulation from comments presented as real. If you are trying to detect whether they are AI-generated, then any noise in your heuristic or model for detecting AI-generated comments is then baked into your results.

OtherShrezzing 1y ago
The study as conducted also suffers those weaknesses. The authors didn’t make any meaningful attempt to determine if their marks were human or bots. Given the prevalence of bots on Reddit, this seriously undermines the study’s findings.

photonthug 2y ago

> At least part of the ethics problem here is that it'd be plausible to conduct this research without creating any new posts. This is a good point. Arguably though if you want people to take the next cambridge analytica or similar as something serious from the very beginning, we need an arsenal of academic studies with results that are clearly applicable and very hard to ignore or dispute. So I can see the appeal of producing a paper abstract that's specifically "X% of people shift their opinions with minor exposure to targeted psyops LLMs".