6 ms·
Reddit Moderators Brace for a ChatGPT Spam Apocalypse
- sharemywin 4y agowonder if there's an incentive structure that could work? AI should be able to spot spam I would think. What if you got bots to downvote spam. not sure how that would work.
- spacejunky 4y agoDon't get me wrong, I'm not a real supporter of LLM's but it's fair to say that not all text which is generated by an AI is spam. Depending on the effort put into prompting and preparation it is quite possible that it is valuable , useful and original content but that the author has used an AI to polish the language. The problem is of course how to distinguish the one from the other. Just using the "AI detection" tools is however not going to get the answer we need. Most probably the usual upvoting schemes will continue to be the best way. I'm going to be quite happy if the quality of the grammar, and in some cases the language, improves. Better quality text makes it easier to concentrate on the real thing I'm interested in: the content and ideas!
- sharemywin 4y agobut let's say I post something and there's 10,000 comments in the first 10 minutes of the post. your going to need something to filter it out. the only other options is pay to post. but even then it's way more lucrative to post spam then real comments.
- manquer 4y agothere are other forms of filtering/ rate limiting like by reputation, HN does this already to some extent for new users < 500 . Recency of reputation changes can be factors so historical accounts don't accrue a lot of value for bots to buy. We will downvote spam or low quality content anyway . Accounts (users or bots) with poor rep can be more harshly restricted. Ultimately does it matter if a human is actually posting if the post is insightful / useful ?
- spacejunky 4y agoI see what you mean. But that's not a new problem caused by AI's, which I think was the original point. I'm sure that all (useful) social media sites have a way to flag, or down vote such massive influxes. Bot recognition of some sort of rate-limit transgression is another issue entirely, and not what I was trying to comment about (content based spam labelling based on "AI" authorship). Perhaps I missed the point of the OP, in which case please ignore me ;-)
- passion__desire 4y agoI consider reddit comments quality to be like a age- and exposure- ladder and not everyone needs to read everything. By that I mean all age groups and expert levels (and now bots) are at one place making it hard to know what is relevant for my context. LLMs will help us navigate the reddit comments on client side. LLMs will prepare a summary report of the reddit discussion and highlight those which need our attention.
- smoldesu 4y agoAn incentive structure for original human-made content, maybe. AI detection seems like a futile fight, thought. Even if you employed the best AI detection algorithms on the market, you'd still have to deal with false positives, missed spam and rapidly-evolving models that can be fine-tuned to adversarial data.
- say_it_as_it_is 4y agoThe dumpster fire that is Reddit braces itself for another flaming tire to its pile
- jjoonathan 4y agoThere is nothing Reddit loves more than hating itself. You would fit right in.
- wincy 4y agoIt’s a shame because the small communities are great. I’ve had an Electrical engineer explain to me the intricacies of stepper motors to better optimize my 3D printers, and the creator of LORA had an in depth conversation asking people how he could improve LORAs for Stable Diffusion. But you’re right, the main subreddits are terrible and have been for a very long time.
- highduc 4y ago>“but I'd bet the farm that traditional social media has a finite lifespan, largely because inauthentic content is becoming so realistic and cheap to make that we're going to struggle to find who's real and who's a bot.” A simple solution would be a physical hardware (human) authenticator, that observes you in visual + IR wavelengths + audio + LiDAR, and functions as a sort of "I am not a robot" check. But then most users would have a ChatGPT template with: "consider the following thread link and compose a response for me that would make me dunk on everyone"
- hooverd 4y agoCould we incorporate some sort of verification beverage?
- jareklupinski 4y agoit might be enough if we stood up, formed our arms into a t-pose, and yelled the sponsor's name into the mic
- croutonwagon 4y ago>A simple solution would be a physical hardware (human) authenticator, that observes you in visual + IR wavelengths + audio + LiDAR, and functions as a sort of "I am not a robot" check. The privacy implications alone would relegate me to not using that thing. I'm not even a huge fan of FaceID, and the only reason I have used it is because the details of its implementation being public.
- highduc 4y agoI was clearly being facetious, but can totally imagine a company coming out with this "solution". Maybe even governments.
- croutonwagon 4y agoSorry I didn’t pick up on it. And there have been govt types that have floated such proposals including expanding the RealID program into something like this. I seem to recall the Brits also voicing the want to try something like this, and they tend to be quite ahead of the curve on the domestic surveillance and privacy invasive policy front.
- symlinkk 4y agoWouldn’t Captcha prevent this, just as it always has?
- falcolas 4y agoI'm sure it would protect us as well as it always has. I.E. it hasn't. Too easy to offload en masse to turks, and AI itself is getting better at solving it.
- voz_ 4y agoReddit has become absolutely garbage. I gave up my account from ~2008 and not looked back. - Clearly astroturfed to hell and back by CCP, Iranian trolls, Russian trolls. - Clearly bloated with viral marketing for various corporations "Look at how quirky my Coke Bottle(tm) is!", "Look at how weirdly my boyfriend eats his Jimmy John's(c) Sandwich!" - The UX is garbage - you need to use Apollo for iOS or old.reddit.com to make it even halfway viewable without the ad spam, UX antipatterns, hard login required locks, etc. - Unpaid mods with massive egos either struggling to maintain the quality of their sub (watch r/art become a porn sub) or completely power tripping (try to complain about homelessness in SF in that sub) - Out of touch management looking to bleed as much money as they can out of the stone, shilling NFTs, Awards, live streaming nonsense, etc while neglecting core features of the site. - The userbase is at a really annoying intersection of smug and ignorant. Everyone is an armchair general, everyone "well actually"s each other, everyone's an expert. To paraphrase someone... you read people's comments, get irate, argue with them, discuss, etc, then you look at their post history and realize you've been arguing with someone who drinks their own piss. And to the point in this article: - Unrestricted use of bots, which makes some whole subreddits just noise, or reposted comments from the last time XYZ was posted.
- icedistilled 4y agoThe sad thing is, that for finding actually useful info instead of SEO spam drivel and copy pasted identical articles just phrased slightly differently, adding 'reddit' to google search is still the best way. Speaks loudly about the state of google and the internet.
- GenerWork 4y agoPeople complain about homelessness in the San Francisco sub all the time though? I'll be honest, I hardly go to that sub but whenever I do it seems like there's at least one post about it.
- jjoonathan 4y ago> astroturfed to hell and back ...which is still less astroturfed than news (of any kind), google results, review sites, and so on. It's one of the only places left on the entire internet where you can find real users talking about real problems with real products. It's really easy to complain if you don't force yourself to identify a better alternative.
- Joeboy 4y agoPresumably that will be happening here too, no? And everywhere else that allows anonymous-ish comments.
- falcolas 4y agoProbably, there's little reason it wouldn't. The profit (karma, attention) is too high for the cost (time, effort).
- Joeboy 4y agoI was thinking the real profit was in "shaping the narrative". But yeah, I can see karma and attention being competitive.
- SoftAnnaLee 4y agoI believe I've seen some comments that may have been LLM-generated. Typically they're top-level, short (1-3 sentences), somewhat on topic, but barely relevant to the conversations happening. Like, for example, on a post of a blog post about a malicious package found in NPM is I'll sometimes see a post like; "NPM is a godsend for developers. Problems can occur, but it has helped developers move more quickly and has made sharing code a breeze." I never report it since I'm not quite sure if it's generated by a program, or merely just a low-effort comment from a human. Which is tricky.
- dang 4y agoIt's anyone's guess what will happen in the long run (or rather, the medium run) but for now the approach that seems to be working is for users to flag the comments that they guess are bot-generated. That's actually the approach we've always taken—it's just that the bots, as everyone knows, have taken a quantum leap recently.
- hyperhello 4y agoI’m fascinated by what automated posting is going to do to these “communities” based on nothing but a desire to type and be seen typing. Was there ever anything worth anything on a Reddit thread, besides advertising that was supposed to look like Reddit? Knowledge, information, learning, wisdom, comedy, tragedy, humanity? Anything that a mindless chat bot combined with targeted marketing couldn’t have generated?
- brucethemoose2 4y agoReddit used to be good gathering spots for niche topics, where users reveled in each other's enthusiasm for said topic and could generally trust that marketing wasn't the poster's goal. A mindless chatbot: - Isn't actually there to be enthusiastic, hence isn't fun to chat about a topic for long. - Cannot practically keep up with new developments in the topic like regulars do. You arent totally wrong though. A bot isnt that different from a karma farmer, and TBH GPT4's confident nonsense rate is lower than many humans.
- subjectsigma 4y agoPeople don’t like this idea but the simplest answer is to have a government owned and maintained authentication system which is backed by cryptography and used for official business. Basically, a National Digital ID. Sure Reddit will remain a dumpster fire, but you won’t have to worry about an AI impersonating your voice to a bank teller. The potential for abuse is high, but such an ID would solve many real problems. Europeans don’t have this aversion IIUC, but this will never happen in America because historically such systems were used by racists to prevent people from voting. Which, obviously that’s bad. But even mentioning a mandatory national ID is like some sort of cultural taboo here which will get rocks thrown at you. I think it’s time we try again and work on applying what we’ve learned from past mistakes to make a better future.
- croutonwagon 4y agoI mean maybe. Until it becomes yet another secret number (ie: Social Security) that suddenly isnt really all that secret at all. Changing anything with the government, and especially ID related is never easy. In fact thats why I have balked at using direct deposit with the IRS. What if i want to change banks, or even simply login to my account without having to subject myself to id.me and their hardline requirements for information with no real oversight in how its handled. I just prefer the "mail me a check" option that i will never have to update since my address is always a part of the tax filing anyway.
- brucethemoose2 4y ago> For now though, the job is falling mostly to moderators. “It's going to require a lot of human labor, which is no fun,” said Gilbert. “We all do this as a volunteer activity.” But Reddit, along with other social media platforms, has a huge incentive to get a handle on this now, before the problem gets worse. “They want people to read their ads, right?” pointed out Gilbert. “It’s not like [Google’s AI chatbot] Bard is going to buy anything.” Well... their history of dealing with crises is not promising. Also, as long as the chatbot is loading the ad, do they really care? In fact, have incentive to not shine a light on just what fraction of their userbase is an automated llm.
- konschubert 4y agoAdvertisers get paid for conversions. When users click an and and then buy something. Sometimes they also het paid for clicks only, which is more prone to fraud. Almost nobody gets paid for impressions.
- deleted 4y ago[deleted]
- tennisflyi 4y agoNSFW communities seem fine. IDC about true exhibitionism as it's all long gone and much is a lead magnet for OFs, Twitter, whatever.