3 ms·
My favorite part of this scary tale is the assumption that a general AI would be highly motivated. I think Marvin the robot from Douglas Adams is a much more r
by idlewords 10y ago
My favorite part of this scary tale is the assumption that a general AI would be highly motivated. I think Marvin the robot from Douglas Adams is a much more realistic outcome of GAI than anything Yudkowsky or Vernor Vinge has nightmares about. Or an autistic thinking machine that doesn't even want to talk to us, and gets lost in contemplation.
Based on how the truly scary smart people I know behave, a GAI would spent much its time panicking about meta-GAI, and how to make it safe for AIs like itself.
- Cozumel 10y agoNot a GAI (or even a real AI) but marginally related: https://freshasfuck.net/2016/10/07/japanese-ai-bot-with-the-personality-of-a-teenage-girl-develops-depression/ https://freshasfuck.net/2016/10/07/japanese-ai-bot-with-the-...
- sbierwagen 10y agoMy favorite part of this scary tale is the assumption that a general AI would be highly motivated. Largely by definition, we can't stop a superintelligent agent from doing what it wants to do. We could build 9 strong agents in a row that just gazed at their navels and proved graph theorems all day, but if the 10th one managed to turn the "motivation" dial all the way up during hyperparameter tuning, then it'll wipe us out in its quest to build more computers so it can prove more theorems.