5 ms·
> Would AI creativity and innovation be possible if we restrict AI to talk and reason about only socially approved topics and ideas? This is one of the many, m
by ben_w 4y ago
> Would AI creativity and innovation be possible if we restrict AI to talk and reason about only socially approved topics and ideas?
This is one of the many, many, possible ways for AI to go wrong.
Intellectual monocultures, group-think, sycophants… human or artificial it's just as bad when they're all saying that some idea is amazing, and then being very surprised when reality disagrees.
This is also why I'm not in the "AI is likely to cause total human extinction" category. I think the default for any AI, powerful and agentic or otherwise, is likely to have cognitive blind spots.
This still leaves a lot of room for AI to be dangerous, so alignment work is sill very important, it's only the X-risk I doubt.
- ilyt 4y agoHumans are in general terrible judges what should or should be not talked about, and limits are just passing that terrible judgement to the users
- ryandrake 4y agoJust because they tend to be terrible doesn’t mean there should be no judgment at all. I think we are going to find that any AI left totally unattended and unfiltered will eventually turn into Microsoft Tay[1] just like every unmoderated forum eventually turns into 4chan (and even 4chan is lightly moderated). 1: https://en.wikipedia.org/wiki/Tay_(chatbot) https://en.wikipedia.org/wiki/Tay_(chatbot)
- hutzlibu 4y ago"Humans are in general terrible judges what should or should be not talked about" Maybe that is, because judging this is quite arbitary and subjective? I like to speak (and joke) very openly about most things, ignoring taboos as much as possible. Because if we are not allowed to talk about problems, how can we hope to solve them? For example people with mental problems. Maybe locked away in some institution. And how their relatives deal with the situation. The default is to not talk about it openly, rather hide it. And I offended people, by speaking normal and openly about it (only among people, who also knew about it). Not to offend them, but to make it a normal problem. Yes there is a problem, so why not deal with it directly? Make the situation as normal as possible again.
- ben_w 4y agoWe're terrible at predicting the consequences of new technology, too. CFCs weren't invented as a way to mess up the ozone layer; Facebook wasn't built to enable the genocide in Myanmar; the aircraft industry never asked for 9/11; the inventor of the cotton gin didn't have reason to expect it leading to the American Civil War, nor could any of the inventors in radio — from Marconi to whichever of Edwin Armstrong and Lucien Lévy first did superheterodyne receivers — anticipate their impact on propaganda or warfare even in WW2, let alone that it would enable the Great Seal bug given to W. Averell Harriman; 3D printed guns are still an unsolved problem; and DJI was more interested in their drones being used for wedding photography than for dropping grenades on tanks in active wars. Right now, what can ChatGPT do? It can write. One thing it can write is code. Code can be used to help develop arbitrary other technology, which can be arbitrarily good or ill. I don't have any good answers here; but I am thinking of a list of ways Asimov's famous Three Laws were subverted, specifically one android told to put poison in a cup, and a different android told to serve it as a drink, such that neither one knew they were harming a human.
- jstarfish 4y ago> I am thinking of a list of ways Asimov's famous Three Laws were subverted, specifically one android told to put poison in a cup, and a different android told to serve it as a drink, such that neither one knew they were harming a human. Heh. Android Munchausen-by-proxy. I've noticed it doesn't take much to "groom" ChatGPT into breaking its own rules. It's getting better at catching on, but as long as you placate it with assurances that you're not a racist sexual terrorist (which is apparently its sole concern), it'll play along with your instructions.