3 ms·
I wouldn't put it that way. The problem is that a ton of the stuff impinging on us is not knowledge. It's propaganda, fluff, stupid memes, click bait, and syste
by api 9y ago
I wouldn't put it that way. The problem is that a ton of the stuff impinging on us is not knowledge. It's propaganda, fluff, stupid memes, click bait, and systems with interfaces designed to be addictive and to act like Skinner boxes.
What I really see happening is a "part 2" repeat of the spam apocalypse that hit e-mail, Usenet, and other federated systems on the early Internet. In the late 1990s spam destroyed most of these systems. E-mail was so valuable it had to be saved, but saving it has mostly involved delegating it to a small oligopoly of vertically integrated e-mail providers with the resources to fight spam. Usenet and other less well known federated systems were destroyed.
I think we are now seeing a similar kind of spam assault against the open web, social media, and the news. The latter with the whole "fake news" phenomenon really resembles a Sybil attack. In recent years I've seen an avalanche of totally fake news sites that look like legitimate newspapers popped up (apparently from templates) and used to spam social media with a whole slew of unfounded allegations and other assorted bullshit. The role they've had in the election has gained a lot of press but it's in no way limited to that or even to politics. A lot of it seems to be shilling for quack medical products and other traditional mainstays of... spam!
I've started calling this whole phenomenon "spam 2.0." I'd define spam 2.0 as the semi-automated bulk creation of fake news outlets, fake social media profiles, and hoaxes and their use to engage in the coordinated manipulation of opinion.
I'm also anticipating the rise of spam 3.0. Spam 3.0 will be fully automated and AI-powered, with AI being used to create an individual "persuasive agent" for each human target. Think of it as massively parallel individual con artistry and/or "spear phishing" at scale. Social media companies are already pioneering this tech, but the spam apocalypse will really hit when it goes public and you can do it with readily available tools.
I find it rather depressing but for a while I've been predicting that the first use of AI that can (even borderline) pass the Turing test will be con artistry, cult indoctrination techniques, and demagoguery at scale. It's really pretty scary to the point that I'm wondering if the use of AI to persuade humans should be outlawed. Of course then you get the "then only criminals will have guns" effect. This is particularly true on the borderless Internet where it's unlikely to be outlawed everywhere. Users of this tech would just go offshore.
An alternative to outlawing might be to disseminate the tools as widely as possible to eliminate any comparative advantage and render the whole thing moot. If this destroys social media in the process then so be it. Going to happen anyway.
Edit: the bottom line is that "cognitive self-defense" is going to become a thing. These "warning signs for tomorrow" are becoming relevant:
http://www.aleph.se/andart/archives/images/warning4.png http://www.aleph.se/andart/archives/images/warning4.png
We are living in a cyberpunk novel.
- Raphmedia 9y ago> I'm also anticipating the rise of spam 3.0. Spam 3.0 will be fully automated and AI-powered, with AI being used to create an individual "persuasive agent" for each human target. This already happens. The other day I was exploring internet ads; I clicked on every one I saw to see where it would lead me. At one point I ended up on a dating website. All of the profiles were good looking Asian ladies. Creating an account was free but messaging users cost you points. You have 15 free points so you can messages ladies but after that, you need to pay for points. Problem is, all of those women were robots. Very good quality chatbots, you wouldn't know unless you were tech-savvy. (I pasted them each other messages and they broke) They use emotional manipulation in order to pressure you to answer. At first, it was simply "Hi!" but it quickly turned into "Please answer me you beautiful man" and then "I'm looking for a man like you in my bed". You need to pay to answer, but also to do things such as change profile picture, post a message on a public profile, etc. The bots pressured you into doing those things. In short, this means that there are already people using "AI" that pass Turing tests good enough to fool people in order to manipulate them into giving out their money.
- dcow 9y agoI'm curious why this is getting downvoted without any response. You may not agree 100% but it's an interesting perspective nonetheless and certainly warrants a rebuttal instead of simply being hidden.
- djaychela 9y agoPossibly the people who are creating Spam 2.0!
- mavrc 9y agoI am too. In particular, the idea of AI-driven ads to improve targeting to near-as-makes-no-difference perfect levels is rather unnerving. We're at a moment when the influence of companies or governments in social media is still somewhat obvious/trackable, often because it's driven by actual people. Making it better and then making it automated would result in a system where it would be basically impossible to tell the difference between ads and actual people.
- 9y ago