4 ms·
Either answers are good or not. It doesn't matter if they're generated by a 13-year-old in their bedroom, someone studying CS at university, a well-respected I
by crazygringo 3y ago
Either answers are good or not.
It doesn't matter if they're generated by a 13-year-old in their bedroom, someone studying CS at university, a well-respected IC at a top tech company... or an AI.
If answers are good, keep them. If they're bad, downvote them. If they're redundant or off-topic or gibberish, delete them.
And to those asking why you would ever want AI-generated content on StackOverflow when you could just go to ChatGPT/Copilot/etc... it's because of all of the commentary. People are giving different answers, arguing the pros and cons, pointing out errors... all of the discussion around a StackOverflow question is usually just as valuable as any given answer, if not more so.
Of course, I understand that AI-powered accounts that can ask/answer hundreds of questions a minute are a problem simply because moderation can't keep up with them. But StackOverflow already has a lot of limits just for human accounts -- lots of actions you can't take until you've contributed certain amounts of value. Just extend these protections to do things like rate-limiting and so forth, to ensure that the normal ratio of content submitted vs. moderated stays constant and manageable.
- raman162 3y agoAgreed. I have found myself sometimes asking Chat-GPT for guidance related to obscure error messages and occasionally its more useful than google or stack overflow.
- rafark 3y agoWhen it doesn’t hallucinate, which in my case it’s most of the time.
- NotTheDr01ds 3y agoSure, but if you try it out, you pretty quickly realize it's a hallucination. Unfortunately the type of GPT content we're now getting on Stack Overflow and its sibling sites is mostly unvalidated GPT hallucinations.
- nologic01 3y ago> If answers are good, keep them. If they're bad, downvote them. If they're redundant or off-topic or gibberish, delete them. Yeah, lets us keep providing free labor to help train somebody else's models, improve somebody else's infrastructure so that they can even more effectively dominate.
- LelouBil 3y agoI think you missed the fact that you are mainly doing this to make other users find relevant answers, on a free website. Or maybe you would want to pay for a version of stack overflow that is only curated by employed people ? But I guess you would lose much content.
- rich_sasha 3y agoAs you say, Stack overflow is free to use. ChatGPT isn't and its scraped web training corpus is not available. So it's not symmetric
- Me1000 3y agoHow is that any different than providing free labor to help someone learn how to build the next [X] so that they can more effectively dominate? But more importantly banning AI generated content from Stack Overflow doesn’t solve the “problem” you’re describing.
- nologic01 3y ago> How is that any different than providing free labor to help someone learn how to build the next [X] so that they can more effectively dominate? Its an absurd equivalence. A human can never "dominate" no matter how much they learn. Training for free a closed, for-profit private enterprize infrastructure that will eventually make your preferred free collaboration platform obsolete is like the ultimate of naivete (or vested interest).
- pixl97 3y ago
- koochi10 3y agoThis doesn't work at scale. Stack overflow as a platform has been handling user generated input via moderators, voting, and testing. This is fine when there are only 26.8 million coders on the planet, most of which aren't posting on stack overflow regularly. With LLM's all of a sudden there is a huge influx of mediocre content on the platform that people can't handle. Inevitably this will erode trust in the platform. When someone posts a answer I assume they actually ran the code, and can verify the result. LLM's can spit out seemingly correct code that just doesn't work.
- kristofferR 3y agoHow are they going to check for LLM usage? I think it's way more likely that poor answers won't mention the usage of LLM's to generate the answer, while good answers aided by LLM's will more often mention it. Punishing honesty just seems incredibly counterproductive. Automatic detection is downright dystopian... being censored by an algorithm because it mistook my effort and work for a LLM.
- NotTheDr01ds 3y agoAgree with the middle part - At the moment, the policy implemented by corporate is "Don't ask; don't tell". If someone says they used GPT or other AI for their answer, it's disallowed. If they try to hide the fact, there's not much the community can do to get it removed. And while I'm not a moderator, as just a user I've flagged over 1,200 answers on Stack Overflow (and several of the smaller communities like Ask Ubuntu) that were subsequently removed. Automatic detection was never the sole criteria that was used to determine if it was AI - It's entirely possible to spot GPT content using multiple methods. I don't publicly talk about most of these, since we do have a group of users (sometimes spammers) who attempt to hide their use and make it more difficult to detect. See some of my additional notes on the topic on https://meta.stackexchange.com/a/389674/902710 https://meta.stackexchange.com/a/389674/902710
- jsheard 3y ago> This doesn't work at scale. See also: the Clarkesworld saga of them being bombarded with mediocre AI-generated short stories. Filtering out bad submissions has always come with the territory, but they're suddenly drowning in them with the advent of LLMs which make it trivial to churn out vaguely story-shaped text on an industrial scale. The generated content isn't good by any measure, but it's "good enough" to pass the smell test and waste a curators time before they realise it has zero actual merit, and there's so much that it becomes a sisyphean task to sort through it. Likewise with image generation, it's now incredibly easy to churn out images that look like something a person might make to express themselves, which are actually just a loosely guided slice through a statistical model of pre-existing images, passing the smell test for "good art" despite having zero actual intent or substance. It's spam, but for culture.
- matsemann 3y agoIf you as an answerer uses an LLM to generate content, then verify and vet it yourself based on your own knowledge before posting, I'd think it's fine. But spamming thousands of answers an hour automatically and wanting the community to do all the work is just not sustainable I feel. It'll also kill the sense of community if half the actors are bots.
- NotTheDr01ds 3y agoAgreed - That's the basis of my "responsible use of AI on SO" post at https://meta.stackexchange.com/a/389675/902710 https://meta.stackexchange.com/a/389675/902710
- x86x87 3y agohaha. no. answers are not either good or not. it's not binary. there is a lot of nuance and sometimes the questions and followups contain details that can take the answers in a completely new direction. just telling if an answer is good or not is a lot of work. sometimes it requires and expert to figure it out. when the answers are given by a human and it's a good faith effort both people in the loop benefit from it. when the BS generation is automated there is zero incentive for a human being to even look and correct the answers. what is the incentive to do so?
- zuiper 3y ago> when the BS generation is automated there is zero incentive for a human being to even look and correct the answers. what is the incentive to do so? You hit a good point here. If users can't be bothered to spend time, effort, energy and cognition into answering a question, why should the readers and correctors do so?
- GrqP 3y agoI generally agree if the content can be kept clean. Certainly, human users will have more to contend with. There are just so many interesting questions by having chatbots interact with StackOverflow: What happens when AI-powered accounts are allowed to vote? What kind of questions might AI-powered accounts be asking or be interested in? How will the questions/answers/responses change between model revisions? You can imagine things spiraling out of control. Perhaps there needs to be a chatbot version of StackOverflow to service all the questions that interest chatbots. :P
- bastawhiz 3y ago> If answers are good, keep them. If they're bad, downvote them. If they're redundant or off-topic or gibberish, delete them. In practice this isn't possible. Lots of accepted answers are bad. Often for subtle reasons! An answer with a SQL injection vulnerability might get plenty of upvotes and be accepted, but it's objectively bad (even if it answers the question). The problem is that there is no AI that's accurately fixing answers. AI only generates mediocre answers, it doesn't have the capacity to moderate mediocre answers. Humans simply can't keep up, or don't have the acumen to pick up on the subtle inaccuracies in accepted-but-bad answers (after all, that's often why they're looking for the answer). Even with protections like rate limiting, I'm not sure you could prevent the majority of the damage that crappy AI can accomplish. Simply paying (pennies) for proxy servers with residential IPs gets around much of that, anyway.
- sholladay 3y agoThe volume is the real problem, as you mentioned. People are worried about AI content because it’s hard to even review it or accurately detect it. I can’t remember the last time I looked at my email spam folder, even though I’m sure there are some useful messages in there, mostly because it would take too much time to go through it. If the inbox starts being filled with AI content that isn’t quite spam, it might start feeling like a chore to go through too, again mostly because of the volume. We will have to see if the existing mechanics of unsubscribe, report, downvote, etc. will be sufficient to hold back the tsunami. My guess is the spam detection arms race will evolve into a content moderation arms race and we will end up with advanced AIs filtering and moderating content for us, to varying degrees of success and things like email, forums, and Q&A sites will become increasingly hands off.
- rich_sasha 3y agoI guess the premise is that it is easier to identify AI-generated content, with a low hit rate (?) of correctness, than to identify correct / incorrect answers based on merit alone. Also StackOverflow is kind of gamified (a rare case of it working IMHO) and the rules of the game don't work so well when kind of good looking content is easy to generate. SE answers are hard to verify but easy to write. If writing becomes too easy, it is a recipe for spam - as has indeed happened.