3 ms·
True. Let me be more precise: the legal system forces (or is meant to force) shortsighted people to deal with long-term consequences. The law is constantly revi
by HKH2 3y ago
True. Let me be more precise: the legal system forces (or is meant to force) shortsighted people to deal with long-term consequences. The law is constantly revised to preempt future consequences, but it is not perfect. (Ex post facto laws are used to punish people who have committed actions that were legal at the time. Loopholes will always exist because language is always somewhat imprecise.)
Now, you might say that AGI will be able to perfectly predict the future of all actions and make the legal system redundant. Ignoring the absurd amount of possibilities, I struggle to believe it's possible because an AGI has no sense of pain to give actions weight; it just has to follow human precedent. Seeming good enough, it could steer humanity into a dead end unknowingly. Also, it might decide that a few eggs have to be broken to make a utopian omelette.