4 ms·
>The Wikipedia article 'Average and total utilitarianism' gives an example: "More counter intuitively still, average utilitarianism evaluates the existence of a
by coldtea 6y ago
>The Wikipedia article 'Average and total utilitarianism' gives an example: "More counter intuitively still, average utilitarianism evaluates the existence of a single person with 100 hedons more favorably than an outcome in which a million people have an average utility of 99 hedons." But far from being counterintuitive, this strikes me as 'obviously true'.
Sounds to me as obviously abstract to the point of absurdity BS.
E.g. an isolated junky with an endless supply of heroin or a person hooked to some "happiness" drip is better than a community/civilization of a million of almost equal contentment people.
Like the "repugnant question" itself, this is a theoritical absurdity, too abstract to have any real value as an ethical experiment.
- concordDance 6y agoA junky doesn't necessarily have high hedons, depending on how you define hedons (they're somewhat ambiguous)
- walleeee 6y ago> Like the "repugnant question" itself, this is a theoritical absurdity, too abstract to have any real value as an ethical experiment. Utilitarian ethics require that people inhabit thought experiments like this. It's dissociation. One ignores the particulars of the event in question, forfeiting context and substituting detached "objectivity". I think it's a mistake to try to purge contingency from questions of morality. Moral questions turn on context, no matter how effective a social technology is the idea that they don't. This is not to say utilitarianism is bankrupt, but should somebody demand one's stance on some variant of the trolley problem, "I refuse to negotiate with terrorists" is not a bad answer, imo
- endominus 6y agoIt's interesting that you say that when we can clearly see trolley-problem style questions affecting real engineering decisions. For example, take self-driving cars. We can take it as a given that at some point such a car will be in a state that it will likely collide with a bystander or else risk the lives of it's passengers. At that point, which lives should it prioritize? Or alternately, the question raised by an international study; if such a car were in a situation where it would either collide with a child or an elder, which outcome would be preferable? Interestingly, different cultures have overwhelmingly different answers to that question. Every moral event has particulars and context, but it's impossible to take in that context at the stage of designing systems, so we need a way of analyzing and reasoning about them in the abstract. Do you disagree with this?
- coldtea 6y ago>For example, take self-driving cars. We can take it as a given that at some point such a car will be in a state that it will likely collide with a bystander or else risk the lives of it's passengers. At that point, which lives should it prioritize? Those which the community will deem as acceptable, based on its historical ideas, tendencies, morals, etc (and adjusted to taste later on, e.g. when the victims pile up, or don't). And that will solidify into a set of laws. There wont be a pick based on some "perfect" abstract theoritical answer on this or that thought experiment.
- endominus 6y agoI know it's not your intent to present one, but I love moral puzzles and you have just generated a delicious one. The core of your comment is that the "decisions" of the car should be based on the community to which it is sold; i.e. a car sold in, say, France should prioritize saving the lives of women, while one sold in Saudi Arabia should save the lives of men (for information on preference data, see [0]). Further, that there should be laws mandating these cultural standards such that (I assume) it would be illegal to sell or manufacture cars not in accordance with said standards. Two scenarios immediately spring to mind. What if I do not agree with the standards, either communal or legal? For example, Burmese standards strongly prefer inaction of the car; what if I consider that wrong, and that there would likely be fewer deaths if the car was allowed more autonomy in its decision-making? Would I be morally culpable if I was the car's programmer and my boss asked me to make the car less responsive (i.e. in my opinion more likely to kill people) so that it could be sold in Burma? Other countries are more indifferent to the car trying to save more lives; would I be a murderer for designing a car for those markets? The second scenario is the more obvious one; your argument hinges on community-derived morals being superior to abstract, though-experiment morals. But that's not a given. There are communities that don't consider certain people as people. There are communities that tolerate infanticide and slavery. There are communities that, in short, have pretty objectively abhorrent moral philosophies. Sometimes those communities have legislative power in a nation. If we concede that the ethics of autonomous systems should be derived by the specific morality of particular groups in power, we will likely end up with some extremely harmful systems. This obviously goes beyond the initial question of self-driving cars into matters of surveillance, social control, AI-driven weaponry, and so on. I just find it important to ask whether you believe that as an engineer, you believe that your own moral beliefs should be completely irrelevant when designing a product - that the manufacturers of Agent Orange or Zyklon B carry no culpability for the use of those products. [0]: http://moralmachineresults.scalablecoop.org/ http://moralmachineresults.scalablecoop.org/
- coldtea 6y ago>Utilitarian ethics require that people inhabit thought experiments like this. Sure, utilitiarian ethics might require this. But moving a level up, utilitarian ethics themselves are not required. Especially in this form. Historical ethics have always been utilitarian - in the sense of serving the preservation/goals of the community (or leaders) that established them. But precisely for that, they were developed not based on astract utility (based on ill-defined terms like "good", "happiness", etc), but on concrete goals, beliefs, etc, and under the influence of concrete desires and historical feedback and struggles ("emergent/evolutionary" would be a better term). The modern eponymous "utilitarian ethics", is an ahistorical, naive version of ethics, where everything is reduced to abstract utility discussions and mind games.
- walleeee 6y agoI agree. All that follows is wild speculation, but... Maybe the utilitarianisms of history maintained concrete referents in part because the notion of "utility" worked somewhere in basement brain. When we pulled it shrieking into the light of consciousness it died and we buried the body under a heap of cope born of the hope that ethics could be reduced to a formalism. (Of course clever and unscrupulous people quickly figured out how to weaponize this as well)