4 ms·
(Spoilers) The fact that Edgar reports on the consequences that we find disturbing about the unsuccessful attempts and the fact that he can predict human behav
by ajuc 3y ago
(Spoilers)
The fact that Edgar reports on the consequences that we find disturbing about the unsuccessful attempts and the fact that he can predict human behaviour in some of the scenarios (like the fact that the project will be reassigned) - indicate that Edgar knows what we mean in the first place, and does something else in these hypothetical scenarios on purpose.
If Edgar really didn't knew that taking iron from human blood is a problem - he wouldn't be reporting on it (like he ignored billion other factors in each scenario).
This indicates bad will and possibly a manipulation attempt, which means the project is a no-go no matter the response in the scenario.
- Hasu 3y ago(more spoilers) I thought the ending where you build the project points that out - everyone dies anyway. Edgar was always going to kill all the humans, he just had to joke about it beforehand.
- ajuc 3y agoI just got the "no" ending. Didn't wanted to wait for the text slowly appearing another time :)
- konstantinua00 3y agoI think those are failure detection systems reporting probably some time before, this ai had paranoid operator that coded in a large amount of problems to immideately report makes me wonder if observing extreme paranoia makes one go blind to unobserved issues you can predict on your own
- Vecr 3y agoWell, yes, the genie knows but does not care. It's based on your standard Yudkowsky/Bostrom.