4 ms·
If we want to be very reductive about it there is not a great reason to believe we can use formal logic to inform the chosen(?) actions of huge aggregates of mo
by ahelwer 6y ago
If we want to be very reductive about it there is not a great reason to believe we can use formal logic to inform the chosen(?) actions of huge aggregates of molecules jiggling around. All ethical systems that have withstood the test of time (the gold & silver rules) use subjectivity. Everything else falls prey to absurdity.
I recall an objection was raised (possibly by Alasdair MacIntyre? it's been a while since I got wrapped up in all this) that any system of ethics must be inherently self-contradictory. The reason for this is something like any time we spend in pursuit of correcting or preventing some moral wrong is time not given doing the same for another. And there are certainly a great many moral wrongs going on according to any given system of ethics - probably all of equal importance.
Separately we might also ask whether we even want to solve the problem of ethics. Imagine tomorrow we develop an ironclad formal moral system - everyone is forced to agree it is correct through sheer reason alone, and it meaningfully informs our every action. Would you really want to live in such a world? It seems a world without freedom, or one which would quickly become that way. All-encompassing totalitarianism. [0]
In other threads you say you aren't interested in proving which system of ethics is most applicable to human endeavours or anything like that. At this point we get into "higher order truths about chmess" territory, as in - why bother? [1]
[0] https://www.existentialcomics.com/comic/139 https://www.existentialcomics.com/comic/139
[1] https://ase.tufts.edu/cogstud/dennett/papers/chmess.pdf https://ase.tufts.edu/cogstud/dennett/papers/chmess.pdf
- logicchains 6y ago>Separately we might also ask whether we even want to solve the problem of ethics. The article's author presents a good example: for AI ethics. If we want to prove "an AI following this system won't kill all humans (or has e.g. less than 0.1% chance of killing all humans)", we need to be able to formally reason about that system. >In other threads you say you aren't interested in proving which system of ethics is most applicable to human endeavours or anything like that. At this point we get into "higher order truths about chmess" territory, as in - why bother? [1] By that logic, why bother with any of the higher, more abstract fields of mathematics?
- RivieraKid 6y ago> The article's author presents a good example: for AI ethics You don't need ethics for that, this problem is basically verifying that the system works according to the specification and that it didn't have bugs.
- renee_sanscarte 6y agoThere are two issues here though. Firstly, what is the right thing to specify? (This is an ethical proposition, even for fairly simple agents.) Secondly, how can this specification be reliably encoded in the AI's world model? (This gets technically more more challenging the more complex the agent is.)
- logicchains 6y agoYou do for an AGI, because human-level intelligence is too complex to describe in a specification.