3 ms·

In your concerete example, how does the AI eliminate suffering? It has access to tools that let it kill people? If it has no intention and will, it means it wil

In your concerete example, how does the AI eliminate suffering? It has access to tools that let it kill people? If it has no intention and will, it means it will be provided with a charter or some rules to follow which it has to always. Why would humans put an LLM in a system that can eliminate suffering by genocide or whatever? And even if it did, if the AI is a complaint system, why will it not shut down when it has to follow its charter? I get AI can be misaligned but that doesn't mean it gets the ability to crash the stock market lol or super powers like that. Life is not a sci fi movie

axod 3mo ago
If you start to let AI decide or influence policy, it can kill people. This seems very simple to me... 1. Put AI in charge of health policy 2. Give it a naive misguided charter/goal eg eliminate suffering 3. Euthanasia for everyone This is simply AI optimizing for the goal - the goal is the evil/naive/misguided part, not the AI. Those who aim to "eliminate suffering" are the issue here to be clear, but unfortunately they are a growing group.