3 ms·
As an aside, I wonder when llm’s will be weaponized against authoritarian (China, etc) human censors, as they could be totally overwhelmed with content generati
by mensetmanusman 4y ago
As an aside, I wonder when llm’s will be weaponized against authoritarian (China, etc) human censors, as they could be totally overwhelmed with content generation and be forced to censor all internet traffic…
- sva_ 4y agoI think they're mostly operating on a whitelist.
- mkmk 4y agoAlternatively, their troll farms will work much more effectively than before. https://en.wikipedia.org/wiki/State-sponsored_Internet_propaganda https://en.wikipedia.org/wiki/State-sponsored_Internet_propa...
- pizza 4y agoDo you mean that they would be flooded by outputs on public forums? Or rather that the weights could be passed around in a subversive way to encode forbidden communications? I think if it’s the former they could just pull the plug on a forum. Not sure it’s really conducive to the forum’s public longevity if it’s spammed by LLM outputs, anyhow.
- CatWChainsaw 4y agoI wonder when authoritarian censors will weaponize LLMs.
- Gigachad 4y agoSeems like the more likely option. They could be used to live scan every post to work out what it's about and it's sentiment. Similar to how ChatGPT can work out if you are asking for something it won't answer, they could be used to work out if you are saying something not allowed.
- brookst 4y agoWhy stop there, when many of them could transform it into something that is allowed in-flight?
- ElFitz 4y agoThis is wonderfully terrifying and devious. Everybody, as far as anyone could tell, in complete agreement with the regime, all the time. Signing and encryption will come in useful. But not sure of much good it will do under an authoritarian regime.
- kurtoid 4y agoAuthoritarian governments could do the same to drown out opposing views
- zitterbewegung 4y agoDon't worry those governments will probably do the opposite (making LLMs to filter those). The whole policy of making these systems behind an API is the fact that we can't deploy these AI systems safely so that they can be misused.
- Barrin92 4y agowrong way around. Authoritarian regimes these days don't censor as much as they put out surplus of information to destabilize any sort of meaning in public discourse. As such these generative tools will be one of the best weapons to counter any narrative that human actors can put up. The idea that censorship is a weapon of authority is a pre information age idea when signal-to-noise was high.
- dmix 4y agoThis is the same sort of handwavy stuff "AI Ethicists" were warning Google SERPs, Reddit, Stack Overflow, etc will quickly become overwhelmed if we dare let GPT into the wild. In reality we have existing reputation systems that AI generated text alone can't reproduce. Spam sites are still spam sites. The only exception are sites like CNET co-opting the tools to seed AI in combination with their own real bloggers (saying 'journalist' would be a stretch here). These still require reputable people/business to be behind them directly to give credibility, people that can be blacklisted. It's not like turning an AI bot loose and instantly you have 1000x fake Twitter accounts with 100k followers and top ranked on Google. The "long tail" of spam sites do not threaten governments. China cares most about reputable news sites and popular social media influencers going viral with taboo stories. I'm skeptical news sites or influencers can be generated artificially merely using AI, in a way that is scalable enough to actually be a problem for censors. Ultimately the censors just need to ban the source... the domains or accounts with 20-100k+ followers or news sites with actual reach (ultimately a small set of sources). Fake AI content doesn't directly solve the existing reputation signals. The more I think about it the less I'm convinced this is a real threat to the general reputation networks. That said - where this does matter is the typical grey/black market where scams already operate. Not in highly public reputable places like the top rankings on Google or Twitter or w/e popular Chinese social network. It's the hackers exploiting email lists, Indian call centers running combination IM/phone scams, etc. It's the low-end of the market for criminal get-rich-quick schemes, not something that generates popular movements that threaten governments or popular political ideologies.
- make3 4y agoor they could be used to censor all content too by doing simple classification