5 ms·
> There's no way to stay ahead of the new language that people create. I'm imagining a new exploit: After someone says something totally innocent, people gang
by Terr_ 1y ago
> There's no way to stay ahead of the new language that people create.
I'm imagining a new exploit: After someone says something totally innocent, people gang up in the comments to act like a terrible vicious slur has been said, and then the moderation system (with an LLM involved somewhere) "learns" that an arbitrary term is heinous eand indirectly bans any discussion of that topic.
- cyanydeez 1y agoyou mean become 4chan?
- Waterluvian 1y agoHey I was pro-skub waaaay before all the anti-skub people switched sides.
- thehappypm 1y agoSkub is a real slur tho so that one doesn’t work
- osn9363739 1y agoIsn't that a reference to a 10 or 20 year old web comic?
- heavyset_go 1y agoThe latter, we're old.
- sitharus 1y agoNo it isn’t, it’s a reference to a Perry Bible Fellowship comic https://pbfcomics.com/comics/skub/ https://pbfcomics.com/comics/skub/ (This one is sfw, not all of the comics are) Even urban dictionary doesn’t contain a definition for skub as a slur.
- Intermernet 1y agoI added one. It's under review. It's very self referential.
- jcynix 1y ago>Even urban dictionary doesn’t contain a definition for skub as a slur. What about this then: https://en.m.wiktionary.org/wiki/skub https://en.m.wiktionary.org/wiki/skub
- sitharus 1y agoThat literally defines it as a word from the PBF comic I cited? Nothing on that page defines it as a slur, just as a word used to mock people who argue about inconsequential things.
- deleted 1y ago[deleted]
- jcynix 1y agoSeems I misunderstood the notion of "slur" as I'm not a native speaker. So now I've learned a bit ;-)
- stirfish 1y agoStop saying it! You're making it worse!
- SV_BubbleTime 1y agoHow dare you use that word. My parents died in the Eastasin Civil war so that I could live freely without you people calling us that.
- tbrownaw 1y agoI'm pretty sure this can work human moderators rather than an LLM, too.
- pyman 1y agoMost of the human moderators hired by OpenAI to train LLMs, many of them based in Africa and South America, were exposed to disturbing content and have been deeply affected by it. Karen Hao interviewed many of them in her latest bestselling book, which explores the human cost behind the OpenAI boom: https://www.goodreads.com/book/show/222725518-empire-of-ai https://www.goodreads.com/book/show/222725518-empire-of-ai
- SXX 1y agoIt's not like this unique to LLMs either. By some little trolling on internet you easily can turn hand "OK gesture" into a hate symbol of white supermacy. And fools will fall for it.
- overfeed 1y ago...and then the bigots will fall for it too, and start using it in earnest, completing the cycle.
- coldtea 1y agowho cares what the bigots use? If the bigots start using "thank you" as some code word, should we stop saying it, lest we pollute our non-bigoted discussions? bigots drink coffee too, maybe we should stop drinking it, because something-something...
- Eisenstein 1y agoIt's all context dependent. There can be words or symbols which are totally benign but when used in a different context do have impactful meaning. Case in point: cheese pizza.
- bee_rider 1y agoI don’t think we should treat human interactions like a technical problem, where we look for edge cases and outlandish hypotheticals to probe the edges of what is possible. If “thank you” became widely associated with bigots, and had some negative meaning, to the point where it genuinely distressed people, I’d avoid it. I think it has a widespread enough normal meaning that there’s almost no chance of that happening, but it isn’t impossible.
- rpdillon 1y agoThis approach gives people you vehemently disagree with a lot of power over you.
- grues-dinner 1y agoThe first half of that already happened with the OK gesture: https://www.bbc.co.uk/news/newsbeat-49837898 https://www.bbc.co.uk/news/newsbeat-49837898. Though it would be fun to see what happens if an LLM if used to ban anything that tends to generate heated exchanges. It would presumably learn to ban racial terms, politics and politicians and words like "immigrant" (i.e. basically the list in this repo), but what else could it be persuaded to ban? Vim and Emacs? SystemD? Anything involving cyclists? Parenting advice?
- immibis 1y agoPeople weren't using the OK gesture innocently. After 4chan trolls decided to start pretending it was a white supremacist symbol, actual white supremacists started using it as a symbol.
- coldtea 1y agoAll 10 of them? What about the other 7-8 billion people still using it normally?
- thephyber 1y agoSome were using it in the traditional unironic (and IMHO cringe) way, similar to anyone who used the phrase “Let’s go, Brandon!” Before that NASCAR race when MAGAs adopted it as ironic + coded vice signaling. Quit being overly pedantic. We all knew there was an unironic purpose for the gesture before it became ironic.