2 ms·
Right. I was referring to the basic set of conditions/steps necessary for the given scenario to develop. Off the top of my head: 1. Loss of control in terms o
by pizza234 11d ago
Right. I was referring to the basic set of conditions/steps necessary for the given scenario to develop.
Off the top of my head:
1. Loss of control in terms of our ability to assess alignment (no longer possible to determine whether an AI is truly aligned); this is happening already (doesn't imply that there are misaligned AIs right now, though)
2. Loss of control in terms of human comprehension of AI outputs - reaching a point where every action or result, including new discoveries, must itself be evaluated through other AIs; we may be close to this, as OpenAI is releasing an internal "AI researcher", yielding recursive AI development
3. Integration of AI into basic aspects and services of society
4. Extensive access by AI systems to physical tools and infrastructure
I think all those points will eventually materialize; sadly I don't see any reason why they won't.