3 ms·
The business to user AI alignment issue is an interesting problem to watch folding out. As you state, if your creating a general help AI for things like search
by pixl97 4y ago
The business to user AI alignment issue is an interesting problem to watch folding out.
As you state, if your creating a general help AI for things like searching you don't want a user asking "How do I solve all my problems?" and the AI responding "Tie a rope around a tree, the other end around your neck and jump". That's how you get the NYT headlines of 'AI kills users'.
But that particular safety approach fails to create interesting 'human' stories. Sometimes the bad guy comes in and performs a genocide setting off the heros story arc. Sometimes the good guy is a terrorist (Luke Skywalker: No, I'm a freedom fighter).
The problem I see here is the power to create interesting and believable fiction is the same power to talk people into suicide. It's the same power to talk a mob in to rioting. It's the same power that could drive a nation to war. As the power to run these models goes from something that requires a datacenter to run down to something that runs in the palm of your hand it's something that society and the world will have to deal with. Any of you that run sites that allow posting won't like the idea of a million virtual Nazi's that never sleep (or maybe you do like the idea of?). Authoritarians in power may love the idea of countless voices spreading their message.
As they say, may we live in interesting times.
- SamoyedFurFluff 4y agoI think we’re focusing too hard on whether or not AI can produce controversial in the sense of villainous stories. I find chatgpt also has issues producing stories from a minority standpoint. It cannot generate interesting stories about being gay, an immigrant, a refugee, incarcerated, poor, disabled, the list goes on and on. It only repeats the most stereotype of minorities, and I fear it perpetuates bias as a result. Even if I ask it to tell me about someone with say an invisible disability, even that is depicted in a way completely stereotyped and not at all reflective of actual experiences.
- squarefoot 4y ago> Any of you that run sites that allow posting won't like the idea of a million virtual Nazi's that never sleep (or maybe you do like the idea of?) If I ran a social site, I would totally love a virtual world filled with virtual nazis, in which quietly confine the real ones, so that they can't pollute healthy environments with their nonsense.
- pixl97 4y agoUnfortunately that's not how they work. Much like the ones that were in Germany in the 30's they love to perform a lebensraum on your website to spread their toxicity rather than stick to their own.