6 ms·
>Even if there was a way to gain efficiency through self modification rather than losing it, it would likely hit a plateau of diminishing returns, like most thi
by yanderekko 3y ago
>Even if there was a way to gain efficiency through self modification rather than losing it, it would likely hit a plateau of diminishing returns, like most things in the world do.
And maybe you're fine with betting your life on that, but the people who are more-hesitant on this are not crazy.
- c_crank 3y agoMost of them I would not call crazy, but relying on poor assumptions.
- simonh 3y agoThe fact that AI alignment is not yet a solved problem, and according to AI safety researchers we don’t have a clear path to solving it, is not an assumption. Further I don’t think that worrying about that in the context of possible super intelligent general AI is poor reasoning.
- c_crank 3y agoAI safety researchers are prone to making wild and spurious claims about what a superintelligent AI is capable of, often relying on scenarios from science fiction or very out there fields of physics to try and get people to pay heed to their ideas. If I had a dime for every time 'possible human extinction' was brought up...
- sverona 3y agoAI alignment is the closest thing to an unsolvable problem I've ever seen.