4 ms·
It's easy to tell yourself you're not evil when you're one small person in an organization comprising thousands (or millions) of people. It would be happening w
by smt88 7y ago
It's easy to tell yourself you're not evil when you're one small person in an organization comprising thousands (or millions) of people. It would be happening with or without you, right? You didn't decide to do these evil things, and not everything the organization does is evil.
Every evil organization in history has been staffed and sustained by thousands of people telling themselves this same thing.
I have a friend at Facebook who absolves(?) himself this way: "I don't want to get into politics. I just want to work on cool code."
He, like many people, believes that being apolitical or choosing to abstain from moral arguments is an innocent position, when in fact it's just the act of choosing the side that's winning.
- pimmen 7y agoReminds me of the song about Wernher von Braun who built rockets for the Nazis and the US. ”Don't say that he's hypocritical Say rather that he's apolitical ’Once the rockets are up, who cares where they come down? That's not my department’ says Wernher von Braun” I think we tech people need to be more interested in what the technology we build ultimately will be used for. I’m not saying we should be paralyzed before every task out of worry, or that we can be morally perfect, but I don’t think we should just throw our hands in the air and pretend that only the person pulling the trigger could’ve done differently.
- abraae 7y ago> I think we tech people need to be more interested in what the technology we build ultimately will be used for. I don't think that's a universally sound position, unless you hold extremely pacifist views. It's too hard to predict the end game for military technology, given that the world is full of bad guys. Should techies work on rockets/guns/missiles? Yes - your country might need them to defend itself against an invading force, or even to menace/subdue a threatening force. Perhaps one day, far in the future, your country will need those weapons when it joins a coalition to invade an otherwise peaceful country that refuses to stop burning fossil fuels.
- pimmen 7y agoI’m willing to concede that it can be hard to speculate what the technology will be used for, but sometimes it’s very easy. Wernher von Braun knew about the Holocaust and that the missiles he built was going to be used by the same regime. The person who works at Facebook in the comment I responded to, who doesn’t want to get all political and just write code, could still have heard about what the technology is used for. Once you have confirmation that what you build will be used for harm I think you should reflect on that. Sure, it might be that the technology is used for so much good that you can defend building it even if it’s also used for harming people, and that’s good. As long as you actually did some thinking and didn’t just say ”I don’t really care about all the bad stuff it’s used for, I just want to make cool code”.
- wpietri 7y agoTotally. If we are building a technology that could be used for good or bad, I think it's especially important that we find out which, rather than just throwing up our hands and cashing the paycheck.
- ryandrake 7y agoThe phrase “your country” complicates things even more. Suppose you have an engineer born in Country A, lived most of his life in Country B, currently works in Country C, for a company based in Country D, on technology being sold to Country E. How should that employee think about country loyalty and the potential applications of his code? I think a good rule of thumb could be: Ask yourself how you would feel if the software you are writing were deployed against you? In other words if the designed purpose of your software application results in winners and losers, put yourself in the shoes of the loser. I think we would have a lot fewer people willing to work on weapons if everyone thought about this a little.
- hos234 7y agoGuilt tripping and shaming your friend isn't productive. He is just going to get defensive or feel bad. People when pushed into that state of mind don't exactly effect change or are open to change.
- daveFNbuck 7y agoIf he feels bad, that's the point of guilt tripping and shaming. If you think it's bad to work at Facebook, you want people who work at Facebook to feel bad about working there. This will tend to make them more interested in leaving the company. If you don't want to be political, there are plenty of other companies to work at where people won't force politics on you for working there.
- BeetleB 7y ago>If he feels bad, that's the point of guilt tripping and shaming. At least you're open about the fact that guilt tripping and shaming is not about trying to change behavior. Feeling bad about it usually has the outcome of avoiding the person making them feel bad about it, not changing behavior. And while I don't have any hard scientific data, the consensus in the world of negotiation is that overt guilt tripping is often less effective than not discussing the topic at all (i.e. guilt tripping increases the chance the undesired behavior will occur). >If you don't want to be political, there are plenty of other companies to work at where people won't force politics on you for working there. Putting the particular case of Facebook aside, my recommendation is always to avoid people who force politics onto you because of where you work. They are usually the least objective.
- daveFNbuck 7y ago> At least you're open about the fact that guilt tripping and shaming is not about trying to change behavior. That's only true if you didn't read the next two sentences. My point was that feeling bad is the mechanism that guilt-trippers and shamers are trying to utilize. I'm sure guilt and shame don't work well in negotiations. I don't know whether that translates to shaping society or influencing your friends. Personally, I don't do it because that's not how I want to treat my friends.
- 481092 7y ago>when in fact it's just the act of choosing the side that's winning In a fairly benign way, maybe. But if you want to take the moral high ground then you should be careful not to steer people, friends and family especially, into an us vs them trap which inherently forces them to militarize their position. Myself, I have no issue with people who aren't for me or against me and I have no idea how the 'for me or against me' phrase could maintain popularity in any civil society. Some people truly do just want to get through life and feed their family without the bs of others trying to coopt their minds and bodies into fighting their personal battles for often petty reasons. I get militarizing against big threats, I served my time, but there's just so many petty battles out there that's not worth wasting energy over and better left to more productive energy.
- wpietri 7y ago> Some people truly do just want to get through life and feed their family without the bs of others trying to coopt their minds and bodies Sure. Everybody wants that. But not everybody gets it. And if some people are getting paid because other people are getting exploited, then their peace is coming at the expense of other people's pain. If the Facebook guy is comfortable with the fact that he is making a living working for a company that is morally dubious (even ignoring that they make their money selling their users up for manipulation), then he should own that. But we aren't all obligated to pretend that isn't happening just so he feels better about his fat paycheck. I used to make a lot of money working for financial traders. But I don't do that work any more because it was at best zero sum, but in practice I think it was mostly parasitic on society. Now I do work that I think is more valuable, even if it pays less. Nobody owes me the difference in pay, just like if I had stayed, nobody would have owed me participation in the fiction that I was doing something worthwhile.
- TheOtherHobbes 7y agoI used to know someone who worked on missile guidance systems. He rationalised it as "I only care about the code." Then there was a war in the middle east and there were TV images of dead and badly injured people being pulled out rubble on the news. They'd been put under the rubble by the missiles he had helped design. He changed jobs not long after. But it would be misleading to reduce this to a moral binary. He wasn't a bad person in most ways, and like most people who aren't bad people in most ways he ended up in that situation through a disinterest in anything outside of his domain, and also because he was allowing economics to do his moral thinking for him. He was doing work that interested him, paying his bills, and keeping on top of the mortgage. What more can you ask of someone?
- smt88 7y agoI suppose the moral question here is, how much do you trust your employer (or country) to use your code only for good? If you're guiding missiles, I think you're naive to think you'll never guide missiles into innocent people. If you're working on Facebook, the question is whether you trust Zuckerberg's moral leadership. It was plausible to be unsure in the past, but at this point, you know he's going to do something unethical and post another "sorry-not-sorry" message online when he gets caught. You know your code will be misused, and that's on you now.
- wpietri 7y ago> What more can you ask of someone? To take responsibility for the effects of their actions? That doesn't seem like too much.