3 ms·
Great article covering a lot of good topics. Especially the overpromise->winter effect and the fact that lots of whats in AI's are nonsense. My favorite part wa
by nickpsecurity 11y ago
Great article covering a lot of good topics. Especially the overpromise->winter effect and the fact that lots of whats in AI's are nonsense. My favorite part was this though:
"The truth is that the part that causes the problem is the actuator. It's the interface to physicality. "
BOOM! That was my exact argument in counterpoints to Superintelligence risks. I thought it was ridiculous to worry about what it thought when you could easily control what it did at the interface. I also pointed out that high assurance security already has decades of work dealing with this exact problem and pretty effectively. So, anyone worried about that sort of things should focus on securing the interface that would be used in various domains to catch issues.
Now, that's not to say a superintelligence can't break an evil scheme down into a series of safe actions that result in catastrophe. There's possibilities there. Just that all methods for handling them can and should be at the interface. And can be implemented by verifiable, dumb algorithms.
- Houshalter 11y agoOnce AI is invented, what's to keep anyone in the world from building one? And not keeping it in a box? And that's assuming the box even works, and the AI can't hack out of it, or trick you into letting it out.
- nickpsecurity 11y agoMy AI that works in concert with surveillance state to hunt their AI's. Plus, anything or anyone too smart will have to be registered and monitored. Basically, the reaction to mutant powers on X-men.