12 ms·
Tech worker resistance is crucial to preventing human rights abuses in the U.S
- morgante 10y agoWe need a code of ethics for software developers, with actual teeth (violating it means you can't commercially build software any more). Edit: it's amazing how much the alt-right has infiltrated Hacker News. The notion that we, as developers, should have a professional obligation to engage ethically should not be so controversial (yet here I am with negative karma for proposing it). To expand on my point: 1. This is hardly a novel suggestion. Lots of positions have professional associations with ethics rules. See engineers, doctors, lawyers, librarians, etc. 2. This is not a union. Lawyers don't bargain collectively. 3. Nobody is talking about illegal immigration. The worry here is around proposals for a database of Muslim-Americans (who are almost all here legally). 4. Nobody is coming for your code. Obviously you won't need to enter your professional PIN to compile code. It just means you'd have to be a member to work for a major tech company.
- anigbrowl 10y agoThat's no more possible than a code of ethics for painters that would prevent them from creating new pictures. But the technical impossibility of this is no barrier to stringent social sanctions that would make it virtually impossible to get hired to any position of responsibility in the future. A code cannot have teeth without being backed up by some organization to do the biting, as it were, meaning some sort of union or professional association whose bylaws enshrine these ethical standards. Otherwise the 21st century equivalent of 'I was only following orders' will be 'that's above my pay grade.'
- tptacek 10y agoAll that's needed to enforce a code of ethics is shop rules requiring membership in the relevant professional organization. That organization needn't be a union.
- morgante 10y agoIt's not a technical problem, it's a social one. Obviously we're not going to make it impossible to code without being a member of the developer guild. But it's totally feasible to make it so you can't get hired by any self-respecting tech company without being a member. Start at the top and things will trickle down quickly. I feel like these sorts of discussions too frequently get entangled with unions and collective bargaining, which they really shouldn't. Lawyers don't bargain collectively, but they're all members of the bar.
- GuiA 10y agoHow do you enforce that? How do you avoid it making software even costlier to build by several orders of magnitude? How do you make sure that outsourced developers that will inevitably be used due to this rise in cost follow the code of ethics?
- tptacek 10y agoHow do ASME members enforce their code of ethics? How do doctors enforce the Hippocratic Oath? We should resist the temptation of assuming that just because software development is new, the professional ethics problems we face are novel or especially challenging.
- yarou 10y agoIMO, you'd be solving the wrong problem. The real problem that needs to be solved is licensing software engineers. This comes with the added benefit of standardizing competence. If lawyers and doctors need licensing, why shouldn't we also have a licensing body for software engineers? Then you get the ethics enforcement for free.
- tptacek 10y agoI'm happy to take on one problem at a time.
- stale2002 10y agoThe issue is that very few people would be willing to be treated by an unlicensed doctor. The same is not true for software and will NEVER be true for software. Nobody is ever going to care if the guy fiddling around with CSS and HTML to make a marketing landing page is licensed or not. Hell, I know small startups that will pay a bright high school student to do stuff like that. Vast swafts of software engineering can be reduced to basic crud web dev that a bootcamper college dropout is capable of doing. There is no "high school intern" level equivalent of medical work that the world has a massive shortage of.
- 10y ago
- tptacek 10y agoI was thinking about this on the drive home. A minimal set: * That we be mindful of the difficulty of our craft and not work on systems where failures can harm others when we're uncertain of our ability to execute reliably. For instance: that we not work on projects that seem likely to produce another Therac-25 disaster. * That we be mindful of the outsized impact technology can have, especially when put to unexpected use, and thus be obligated to design systems with all reasonable safeguards against misuse. For instance: that we not work on projects that are benign when used as designed, but that are easily turned into instruments of mass surveillance --- like: a big chunk of the network security product market. * That we design and build systems that ordinary users can reliably use safely and, where applicable, securely. For instance: that we don't repeat the mistakes of Adobe Flash.
- quesera 10y agoNumbers 1 and 3 are great. Number 2 is effectively impossible. You correctly point out the entire netsec industry, but it goes much much further. Cisco, Oracle, Google, and Facebook would all immediately fail that test. I would shed no tears, but it'd be a tough sell with most people.
- tptacek 10y agoYou'd be surprised. Sit down with a group of smart people, isolate a single problem, and pick it apart. For instance: you've got a giant database of sensitive information that could be used to build a(nother) national Muslim registry. So: * Aggressively aggregate data into statistical aggregates that address your business questions while discarding, the way we already do for credit card data, sensitive information we don't immediately need. * Seed the database with false information in a way that allows it to answer the business logic questions your application needs, but that would respond to an unexpected compelled production request with data that would be untenably expensive to true back up. * Design the system so that it can efficiently answer the questions the system was designed to answer, but that takes proof-of-work-scale effort to answer other questions. There are already database systems with these designs. There are plenty of other answers; this was like a 5 minute conversation in a bar in San Francisco a few weeks ago. The point is that rule #2 isn't a professional obligation today, so there's little incentive to design comprehensive safeguards --- or really even to conduct the misuse modeling exercises that would even suggest what kinds of countermeasures are needed. What I think is the case is that we won't come up with good solutions to these problems until we make them professionally mandatory to solve, so that their solutions enable new revenue by enabling applications to be built that could not be built ethically otherwise.
- intransigent 10y agoWouldn't that require the building of a database that is used to discriminate against individuals listed therein?
- morgante 10y agoI feel like you're trying to make some witty point, but it's actually totally nonsensical. Yes, I absolutely want a database of ethical software engineers and wholeheartedly support discriminating against people who aren't in it.
- tptacek 10y agoAlmost every other major profession has rules like these. You can't even prepare taxes without complying with a code of ethics. This isn't the crazy logistical challenge you're making it out to be.
- intransigent 10y ago- Taking the hippocratic oath - Passing the bar - Obtaining a pilot's license - Completing series 7,(63,66) exams Yes, these are things people do. But these things are each different from each other, and different from a petition. Some of them are not centralized lists, and others are not calls to political action. Meanwhile others are discriminatory, in that they distinguish those who have proven proficiencies, as capable practicioners of valuable skills. Simply affirming a willingness to act in a certain way only means so much. Refusing to act means less. Indicating an intent to prevent others from acting is yet another behavior. Advertising any political intentions, regardless of actual skills or rationale, may carry sentimental value, and that's nice, I guess. Meanwhile the possession of technical skills, which rest on the firmament of electrified silicon substrates, with open-ended usage patterns, which may eventually lead to these objects ...behaving with some semblance of ...sentient free will? Deciding thier own ethics? In ways not obvious to the inventor? Are their parenting licenses? Just kidding. That last part's a can of worms all its own.
- tptacek 10y ago
- abstractbeliefs 10y agoBut who decides what's ethical? I struggle with the same issues here in the UK, where the professional body for tech, the British Computing Society (BCS) is not just toothless, but in my eyes, actively harmful (for example, chose to vote _in favour_ of NSA-like practices at GCHQ - including giving evidence (in the form of an expert statement) to the government). I think what is important to realise is that something approximating the majority of people do actually go against the values typically espoused by the people who visit HN, not just in the wider public but also within tech. And even discounting those, how many people are quite happy to just do as told? How do we work to distill the concept of professional ethics in tech from these people, and then instill it?
- idlewords 10y agoI think a good first step is to learn from groups—doctors, librarians, lawyers, engineers—who have such a working system of professional ethics in place.
- brighteyes 10y agoDefinitely true, and all the ones I am familiar with are purposefully non-partisan. That is, they define as ethical things that both Democrats and Republicans agree on.
- idlewords 10y agoThat's very much not the case. Consider the epic battle between librarians and John Ashcroft in the wake of 9/11, over patron privacy.
- brighteyes 10y agoI am less familiar with the librarian code of ethics, but yes, from what I've heard they are quite unique and different from the others.
- 10y ago
- ar15saveslives 10y agoWhat do you mean "you can't build"? What does "build software" mean? You can't run gcc anymore? Contribute to opensource? Publish your app? What would you add to that "code of ethics"? Should I be banned from "build software" if my library is used in non-ethical (in someone's opinion) project? Is working for institutions in countries that violate human rights (UAE?) should be considered "unethical"? Just take your witch hunt ideas and leave us alone.
- idlewords 10y agoA reasonable code of professional ethics is not a witch hunt.
- flamedoge 10y agobased on whose "reason" is reasonable?
- idlewords 10y agoBased on broad consensus within the profession, like happens in journalism, law, medicine, social science etc. etc.
- flamedoge 10y agoNegative enforcement by punishment is not likely to hold well for programmers. What are you gonna do, ban all hacking? good luck trying to enforce that.
- sean_patel 10y ago> We need a code of ethics for software developers Since you went there, we also need a Union to protect our rights and prevent overtime abuse (esp. at Startups).
- morgante 10y agoNo we don't. Please don't bring in unrelated issues to muddle the waters. We can have a professional association without having a union.
- adrienne 10y agoSure, but we still need a union, too. Just because a large proportion of capitalism-worshipping Hacker News bros think unions are eeeeeevil is no reason we should shut up about them.
- morgante 10y agoFor the time being I'd rather focus on a professional association, since talk of unions will send those capitalist bros running for the hills (and I think ethics are more important than protecting our salaries). Also I think we're professionals. Doctors and engineers are doing just fine without unionizing.
- adrienne 10y agoUnions aren't just about salaries, they're about resisting all sorts of unfair management bullshit. And developers may be "professionals" (that's kind of a loaded fucking word; carpenters are professionals too, and they have unions), but we are also the victims of a lot of unfair management bullshit, including unpaid on-call time and mandatory unpaid overtime (oh, but we're exempt, that makes it okay? Fuck that.) I'm more concerned with ethics than salaries, too. Which is precisely why i think unions are important. Corporations have no ethics. Management has no ethics.
- 10y ago
- slavik81 10y agoAny self-regulating professional organization ultimately is granted its status by the government. If its ethics deviate significantly from that of wider society, it will lose support in government and will probably not survive as an organization. Trying to create a government-appointed organization to oppose a government policy is simply foolish. It's not going to happen.
- morgante 10y agoThere are plenty of examples where legal ethics or librarian ethics have conflicted with government policy.
- slavik81 10y agoWhile that is true, they largely agree with policy. There's only occasional conflicts. Those organisations have long histories and clearly defined, non-partisan principles that most people largely agree with. Congress is not going to pass a law to deport Mexicans and Muslims, then pass a law to establish an organization that is designed to thwart their previous law.
- morgante 10y agoPerhaps Congress won't, but that's assuming that government is unitary. Professional licensing is done at the state level anyways. It would be very easy to imagine, for example, California passing a law to establish/bolster a developer guild at the same time that Congress is trying to deport Muslims.
- slavik81 10y agoI don't think state governments could bar programmers from working on federal projects. I suppose they might be able to bar them from working on anything but federal projects, though. Maybe. I'm not exactly a constitutional scholar.
- 10y ago
- carsongross 10y agoWe need a code of ethics for writers, with actual teeth (violating it means you can't commercially write any more). We need a code of ethics for directors, with actual teeth (violating it means you can't commercially direct films any more). This is fun!
- morgante 10y agoWe need a code of ethics for lawyers, with actual teeth (violating it means you can't practice law any more). We need a code of ethics for doctors, with actual teeth (violating it means you can't practice medicine any more). You're right, this is fun! (Also, really poor choice of examples. Both writers and directors have large and successful unions.)
- deleted 10y ago[deleted]
- threatofrain 10y agoThe AMA or ABA is useful for censuring activities which are obviously noxious to broader society, which helps it manage its standing within society, but I think that is almost the entirety of the motivation, utility, and scope of professional ethics. Nevertheless I think there are advantages to organization and I hope for more of it. That being said, You can't stop a metaphorical mass database of Muslims at a time when there's sufficient political support to do so -- and there's plenty at the moment. A lot of people see <it's just information, what do you have to hide if you're righteous> as a good enough reason, enough to generate broad acceptance. There's also enough political support to build illegal mass surveillance machinery, and then lie to Congress about it. The aggregate of the US is okay with that, just like how the aggregate of the UK is okay with even more in-your-face surveillance. Likewise, you cannot stop the documented abuses of psychiatry when there's all too much political support for it. There are useful reasons for a union, and I hope it so for the health of the technology community, but I don't think it can dent the issues which people mean by this "never again" political speech (big databases of people -> risk to vulnerable minorities).
- clarkmoody 10y agoHow about we work to make the government small and weak enough that it doesn't have the capability to commit large-scale human rights abuses?
- divbit 10y agoThe problem is that there is more than one government in the world.
- idlewords 10y agoThis seems like a laudable goal, but what are concrete steps that would help make it happen in the next year, say? Because that's the time scale we're up against with policies like mass deportation.
- comicjk 10y agoThe US government, no matter what its size, has been capable of large-scale human rights abuses throughout its history. How small do you plan to make it? As small as it was under Andrew Jackson?
- krapp 10y agoThen you have two problems: large-scale human rights abuses by private interests, and small-scale human rights abuses by the government.
- curried_haskell 10y agoThe problem is we need _something_ like government to advocate for, and protect the safety and interests of the people. Something that has teeth. Because without it, we, and our land, and resources, will be raped.
- jubalfh 10y agoHow about we make everyone a monarch and everyone's house a castle?
- chrismcb 10y agoI don't get it. You are saying you don't want to make a database that the US can abuse(but it is OK for other countries?) but then you concede that the US probably already has the best database, but, wink-wink, they won't abuse it?
- tptacek 10y agoNo. The pledge acknowledges that abusable databases exist. It doesn't ask that people leave companies that maintain those databases. What it demands is that signatories commit to resist abuse, and, ultimately, to sever ties with employers that abuse those databases. The fundamental idea is that if enough people sign, management at tech companies will have to make decisions to comply with unethical government orders knowing that the discovery of their compliance (which is inevitable) might cause significant retention problems.
- brighteyes 10y ago> The pledge acknowledges that abusable databases exist. It doesn't ask that people leave companies that maintain those databases. What it demands is that signatories commit to resist abuse, and, ultimately, to sever ties with employers that abuse those databases. In practice, developers work on those databases in Google and Facebook. They'll be "ok" because they don't know they are abused. Other engineers in those companies will work on giving the government access to it (as Snowden documented), and they too will not see any abuse so they are ok. The government gets that information and does what it wants with it. It might be abusing it right now. (There have been many deportations under Obama, for example, with little uproar; it's possible tech databases helped in those.) The pledge is toothless. To be actually effective, it should have called on people to not work at Google and Facebook.
- tptacek 10y agoThe pledge commits them to resign from Facebook or Google should either comply with a USG mass deportation program. That's not "toothless".
- jimmywanger 10y agoThis article is fairly silly. > “We refuse to participate in the creation of databases of identifying information for the United States government to target individuals based on race, religion, or national origin.” National origin - don't you have to declare what country you were born in to visit/emigrate to the United States? This is trying to legislate intent, which fails miserably. One thing we've seen is that if the database/tool exists, it'll be used in ways that nobody had ever thought of before. > I’m not one of the people who seriously believes that the cost of deporting millions of people will deter the Trump administration from doing it (one easy way to reduce costs: don’t deport people humanely). But history tells us that, whether you do it humanely or not, this kind of large-scale human rights abuse I like how she goes straight from deportation to large-scale human rights abuse. If you deport illegal immigrants (regardless of national origin or faith), you're enforcing the law. Period, point blank. To stretch that into human rights abuse is far-fetched at best.
- pcwalton 10y ago> I like how she goes straight from deportation to large-scale human rights abuse. If you deport illegal immigrants (regardless of national origin or faith), you're enforcing the law. Period, point black. To stretch that into human rights abuse is far-fetched at best. So if something's legal it can never be a human rights violation? Tell that to the Japanese people we interned in World War II.
- jimmywanger 10y ago> So if something's legal it can never be a human rights violation? I said it was far fetched. Many legal things can be considered morally wrong but without a consensus of what's morally right or wrong, the law is what we fall back on. What are you proposing, doing whatever feels good at the moment while ignoring the law?
- pcwalton 10y agoThankfully morals don't depend on what is currently popular. Of course, mass deportations are also unpopular. I'm proposing that we don't tear families apart for no benefit.
- wcummings 10y agoStrongly agree, the lack of ethics in our field is deplorable. If people were building software for gas chambers HN commenters would find a way to excuse it.
- adrienne 10y agoI've literally seen different HN commenters say some variation on "maybe some people are just not valuable enough to keep alive" three times today.
- joshkpeterson 10y agoThis place is pretty toxic.
- adrienne 10y agoHN commenters wouldn't just find a way to excuse it; they'd find a way to monetize it. They'd jump all over themselves about it, too.
- legostormtroopr 10y ago> We refuse to participate in the creation of databases of identifying information for the United States government to target individuals based on race, religion, or national origin. This would mean I can never work on a system to support a social program that identifies at risk minority children to improve health care initiatives. No one can ever work on a national census again, or demography surveys. It also highlights the "Americ-centric" view from a lot of tech people. The US government is right out, but despite this pledge talking about their recent Genocides, its perfectly fine to build these systems for Bosnia or Rwanda. I'm also curious to know to whom anyone can "whistleblow" to now days, especially now that people are trying very hard to paint Wikileaks as a Russian front. Ultimately, this is too broadly worded and toothless. I'll just stick to "First do no harm".
- idlewords 10y agoThat's kind of a wilful misreading of the text. The mention of "targeting individuals" explains the intent of the pledge. This pledge is US-centric and should be US-centric, because that's the jurisdiction these enormous sets of user data live under. As far as who people can whistleblow to, there are any number of tech journalists and public figures with a well-earned reputation for integrity.
- legostormtroopr 10y ago> identifying information for the United States government to target individuals based on race, religion, or national origin. > to minimize the collection and retention of data that would facilitate ethnic or religious targeting. Those are the only two instance of "target" in the text on http://neveragain.tech/ http://neveragain.tech/. There is no context on the pledge and that's what they are asking people to sign. Governments target individuals for a broad number of entirely valid reasons, for healthcare, social services or law enforcement. Some genetic diseases are racial or ethic - if a new genetic disease is discovered, is a national health service obligated to or discouraged from contacting members of that racial group? Scientology is a "religion" that has had a sketchy background, should we make it impossible to build a database to track members?
- droopybuns 10y agoThis was my first thought also. I feel like the article is a masterclass example of liberal peacocking with obvious unintended consequences. It will be followed by a chorus singing the virtues of their good intentions, I'm sure.
- anigbrowl 10y agoPost your improved version then.
- droopybuns 10y agoThere's no way to make the case this person is trying to make. It's also hypocritical to make this case now that the team with the branding they don't like is in power. This type of sanctioned prejudice has been going on for decades. https://www.bis.doc.gov/index.php/forms-documents/regulations-docs/federal-register-notices/federal-register-2014/1063-746-1/file https://www.bis.doc.gov/index.php/forms-documents/regulation... The best counterproposal I can offer is this: "Don't do evil things, asshole."
- dang 10y agoPlease don't do ideological trolling here. If you have a point to make, make it substantively and without name-calling. HN comments need to get less inflammatory, not more, as topics get more divisive and partisan. We detached this subthread from https://news.ycombinator.com/item?id=13173556 https://news.ycombinator.com/item?id=13173556 and marked it off-topic.
- brighteyes 10y agoIt's true all human beings - including software engineers - need to think about ethics and to avoid participating in human rights abuses. But the "Never Again" pledge is a simplistic, knee-jerk way to do that. Refusing to build a database of people based on their ethnicity or religion sounds like a good idea when you think of the possible abuses it can be used for. But the US census gathers precisely that information, and (almost) no one freaks out about it. Google and Facebook already have that information, and (almost) no one freaks out about it. The only reason someone is freaking out now is because Trump was elected. Now, that might make sense - maybe a normally harmless database will be put to horrible use by him. He has said horrible things. But he's also shown a lot of what he says isn't intended literally. We do need to be careful and vigilant. But "Never Again" isn't a good way to do that. Another issue is with this kind of thinking: > But history tells us that, whether you do it humanely or not, this kind of large-scale human rights abuse requires huge numbers of people working together with the full knowledge that they are committing human rights abuses. No, as Hannah Arendt and many others have shown, large-scale human rights abuses often do not involve lots of people consciously doing evil. Instead, they usually think there are good reasons for what they do.
- idlewords 10y agoThe census collects anonymized information, and does not use it to "target individuals". The pledge does not apply there. People are absolutely freaking out about Google and Facebook collecting this data. I don't know why you think this (almost) isn't happening.
- brighteyes 10y agoA tiny, tiny amount of people freak out about Google and Facebook's massive data collection. Not enough to be noticeable in the market shares of those companies' products.
- idlewords 10y agoThe interesting metric is how many of their employees are getting worried enough to take collective action. And that number is not negligible.
- deleted 10y ago[deleted]
- jtcond13 10y agoSure, force your boss to have the H-1B guy write that SQL query. Then hop on the Google Bus and try not to think about the ways in which the tech industry is rotting away American democracy (c.f. "Facebook is confirmation bias at scale").
- idlewords 10y agoThe H-1B guy is not going to write the query to get himself deported. Even we immigrants are smarter than that.
- legostormtroopr 10y agoWhy would the HB-1 guy be worries about deportation? HB-1 guy has a legal visa to be in the country.
- marcoperaza 10y agoIf you haven't been paying attention to the news: the only change Trump is making in deportation policy is a commitment to deport all convicted criminals who are here illegally. Even if Trump wanted to get rid of all illegal immigrants, deportation would be an incredibly wasteful and silly way to go about it. He would just ramp up enforcement against employers who hire them, who are already committing crimes by doing so but are largely getting away with it. A bunch of leftist software developers waving their broomsticks angrily in the air isn't going to change anything. When did everyone start thinking that they're Rosa Parks? Not all causes are created equal. Not every act of defiance is an act of heroism.
- tptacek 10y agoThe reason your comments are getting flagged off the site is that instead of calmly making an argument, you're name-calling, such as you did here with "leftist software developers waving their broomsticks angrily in the air".
- marcoperaza 10y agoI think it's an apt metaphor for the situation. I don't see how calling someone 'leftist' is negative name calling. People easily become exuberant and angry about politics. On the very rare occasion when my comments get flagged, I don't take it personally.
- tptacek 10y agoIf you follow 'dang and 'sctb's comments --- the informal mod log for HN --- you'll see that pretty much everyone who gets flagged (or banned) for name calling says some variant of this. The answer is, just don't call people names. Make your argument calmly and simply, rather than baiting people into incivility.
- deleted 10y ago[deleted]
- 10y ago
- brador 10y agoOne step closer to a software engineer union. Move faster. It's time.
- stale2002 10y ago" target individuals based on race, religion, or national origin." Ok, but what about a database used to target people who aren't in the country legally? Is that a human rights abuse? No race, or gender targeting.
- threatofrain 10y agoI don't view a decentralised resistance of technology workers as the right remedy behind this "Never Again" movement. * It underestimates the amount of diversity which exists within the tech community in terms of political or moral beliefs and attitudes. Just a small fraction of disagreement is enough technical capability to build a lot of things for big entities. * The AMA or ABA is useful for censuring activities which are obviously noxious to broader society, which helps it manage its standing within society, but I think that is almost the entirety of the motivation and scope of professional ethics. Nevertheless I think there are advantages to organization and I hope for more of it. That being said, You can't stop a metaphorical database of Muslims at a time when there's sufficient political support to do so -- and there's plenty at the moment. There's also enough political support to build illegal mass surveillance machinery, and then lie to Congress about it. The aggregate of the US is okay with that, just like how the aggregate of the UK is okay with even more in-your-face surveillance. Likewise, you cannot stop the documented abuses of psychiatry when there's all too much political support for it. * I anecdotally see tech workers as constituting a small % of society, and as too politically diverse and unorganized to do anything interesting. The tech community places too much responsibility on itself without a commensurate degree of reliable power to back it up.