3 ms·
I'm going to play devil's advocate here. Assuming that an engineer is aware of the eventual applications for his or her work and is ethically mature enough to
by john_b 13y ago
I'm going to play devil's advocate here.
Assuming that an engineer is aware of the eventual applications for his or her work and is ethically mature enough to recognize that some of those applications are evil, destructive, or violate the rights of others, it doesn't necessarily follow that this engineer should refuse to do the work. For one, just recognizing that a technology has harmful applications--even only harmful applications--and refusing to build it doesn't mean that the technology will not come about anyway. If you find the applications harmful and refuse to work on it, others may--and likely will--step in and build it instead. So there is a game theory issue that the article ignores. If many people can profit (financially, professionally, learning) from building technology that eventually becomes harmful, then a sufficient number of those people need to refuse to work on the technology in order for it to not be developed. But decreasing the scarcity of labor will increase the value of it, and thus the rewards for developing this harmful technology will be increased, which creates a more powerful incentive for engineers to "defect" (in the prisoner's dilemma sense) and work on the harmful tech.
There are also objectively good benefits to doing work that is eventually harmful. If you have a family, you can feed and clothe them. You can learn skills and that will help with non-harmful work in the future, and you will meet people who may help you do non-harmful work later. Being intimately familiar with this technology, you will be able to warn others of the dangers of it. Whether these objective goods outweigh the potential bads of a technology is difficult to determine during its development. And where the balance is difficult to determine, engineers, being practical and conservative by nature, will tend to side with the tangible benefits they can get today over the intangible costs that others may incur in the future.
I agree with the article's point that engineers need to develop a broader societal focus[1] and be mindful of the potential uses, especially the unintended ones, of their work. The problem is that awareness alone isn't going to accomplish much because a world full of aware engineers doesn't change the existing incentives.
[1] A good book on this topic is "The Civilized Engineer" by Samuel Florman: http://www.amazon.com/Civilized-Engineer-Samuel-C-Florman/dp/0312025599/ http://www.amazon.com/Civilized-Engineer-Samuel-C-Florman/dp...
- JoeAltmaier 13y agoMoral behavior is not a 'game theory' concept. It is what you do even when you don't 'win'. At its heart, moral behavior is NOT doing whatever it takes to benefit yourself, which is the sum of game theory. So yes, if your project has only harmful application then you shouldn't work on it. Even if someone else most assuredly will (I'm guessing that could be you). Because its wrong, hypocritical.
- john_b 13y agoIf you look at these things at an individual level, individual morality is a useful lens. But this topic is really about a class of professionals within a whole society. Influencing behavior through moralizing unfortunately works much better in the ancient tribal environment in which it evolved, where shame and ostracization could be used to punish wayward members of the tribe. The reality of large societies is that a certain percentage of people will do immoral things even when they know those things are immoral, because they can get away with it or even profit from it. And they will do this especially when the rewards for immoral behavior increase asymptotically due to supply constraints. Using morals to provide solutions only gets you as far as "X should Y". But prescribing "shoulds" doesn't solve anything. Changing incentives does. How to do that is the real question.
- JoeAltmaier 13y agoUnfortunately we all only really can change our individual behavior. So individual morals is all there is. Given that, you can 'go with the flow' and become a person that does immoral things, or you can hold the line and perhaps be an example. And keep your self-respect.
- MichaelGG 13y agoHow is it hypocritical? Working on something harmful may put you in a better position to do something about it.
- prodigal_erik 13y agoOnly if you have faith in some kind of mystical virtue separate from all consequences of your acts in the real world. Even an ethical altruist wouldn't be required to make an empty gesture which doesn't benefit anyone.