8 ms·
As software engineers/computer people, we have to have ethical standards. If you participate in writing code like the one in the VW case then you are not only c
by godelski 8y ago
As software engineers/computer people, we have to have ethical standards. If you participate in writing code like the one in the VW case then you are not only complacent but active in fraud.
Engineers have a code of ethics. If you were to knowingly build an unsafe bridge then you would be liable for the damage and injuries it caused if/when it failed. This is true even if your boss told you to do it. You not only have a moral/ethical obligation to not build that bridge, but also a legal one.
As we write software we need to keep these things also in mind. We are writing things that affect peoples lives. That could kill people. That affect the environment. We need to hold ourselves to the same moral obligations as other engineers. We have a duty to prevent harming people when we write our software.
If you have no stand to refuse to do the work then it is your duty to report such actions. First up the chain, and if that is rejected, then to the media. It is also your duty to report it if you have refused and you see it still happening. There are whistleblower rights in place to protect you.
- adamson 8y agoCivil engineers also have professional associations and certification boards backing them up in most jurisdictions whereas we do not. We don’t have anything to appeal to when we go to our boss with ethical concerns besides, well, our sense of ethics. If the order has already made it down the chain, that sense is probably not shared.
- ghaff 8y agoFWIW, software engineers do have professional organizations like the IEEE and ACM, whether or not they back members in any significant way. There are also PE licenses although my understanding is that they are being discontinued for software engineering because basically no one was getting them in that field.
- PeterisP 8y agoThe thing that matters is not whether professional organizations exist, but whether their acceptance is mandatory. The reason why this works in civil engineering is because the boss or the company cannot overrule the engineer. If the engineer declines to sign off some thingy as acceptable because X, Y and Z must be addressed, then that's it - the company can't proceed until the issues have been resolved; the management can't sign off by themselves, and they can't really even fire the engineer and get someone else to sign off for that because a complaint from the fired engineer about that would result in the process getting an independent review, (assuming the issues are real) the process getting stopped anyway, and the unethical engineer who agreed to sign off despite these flaws losing his/her licence - so that even if not signing gets you fired from one place, it's still the better choice than signing and being unable to ever work in that profession again. "Ethics standards in a profession" mean the standards that the profession imposes on its members even if they and their employer want to violate these standards. Without effective enforcement, however, the whole process would be useless.
- jpindar 8y agoDoes all that happen often?
- acomjean 8y agoI don’t think it happens often. Though Lawsuits are not uncommon in civil engineering. When I worked as an EIT (passed the state engineering exam, on way to becoming a Profesional engineer), our office did an analysis on someone else’s slope stability calculations, because the slope wasn’t stable and they wanted to figure out if it was done properly. Civil engineering designs have a clear paper trail and the buck stops with the engineer who signed and stamped the drawings.
- godelski 8y agoIn many cases it is "you can over rule once", because that's all you're going to get. So no, it doesn't happen often, but the engineer legally has that power.
- ghaff 8y agoOf course, at least many of the mechanical engineers at auto companies most likely do have PEs. It's not just civil engineers. It's mostly any engineer/engineering manager who signs off on drawings, test, etc. for regulators. When I worked on oil rig designs, I started down the path to getting a PE and it would have been expected had I stayed in that business. That said, I'm sure there would be lots of complaints if software had a similar system given that it would likely come with specific educational and other specific requirements.
- martythemaniak 8y agoSoftware engineers don't understand they're not professionals. I mean, they describe and think of themselves as such, but they are not legally such. Being a "professional" legally means that you're given exclusive rights to perform some economic activity and in return for this (usually) lucrative right, you have a great number of obligations - being responsible for your work (ie, facing the possibility of never being able to perform said economic activity legally again), an enforceable code of ethics, an dispute / resolution process etc, steep fees, continuing education, an accreditation exam, etc. Software engineers by and large do not want the obligations and restrictions of being a real profession, so no, they don't have any special ethics or rules to report or do anything in these cases beyond what a designer or secretary would do.
- cjhanks 8y agohttps://www.ieee.org/membership/qualifications.html https://www.ieee.org/membership/qualifications.html Search for, "Member grade". The only path for a large portion of all people being called "software engineers" would not even be considered for 6 years. Those 6 years would probably be the most formative in educating them of their ethics and responsibilities. A service I am not sure IEEE really prioritizes anyways.
- kevin_thibedeau 8y agoIEEE can do whatever it wants. They don't certify anyone as a professional engineer. That is NSPE's job in the US.
- cjhanks 8y agoYeah, I am apparently not qualified to receive anything based on experience. https://www.nspe.org/membership/types-membership https://www.nspe.org/membership/types-membership Or if I want to pay them to get a certification no one cares about, I can. https://www.nspe.org/resources/education/exam-review-and-preparation https://www.nspe.org/resources/education/exam-review-and-pre... The system in that regard is broken.
- 8y ago
- agentofoblivion 8y agoThis is easy to pontificate about. How do you actually bring about culture change?
- gnulinux 8y agoEducation. Engineering and science schools should have good and rigorous ethics courses. Taught by actual philosophers and engineers on the field dealing with ethically sensitive issues (like writing a real-time OS for an airplane, self-driving car etc). An engineer or a scientist shouldn't graduate without the ability to reason about the social and ethical implications of their jobs. Engineers, physicists, scientists, social workers change the world more than most individuals and thus they need the ability to reason ethically more than most individuals.
- lawnchair_larry 8y agoDo you think that teaching an unethical person about ethics makes them ethical? I never understood the point of ethics classes. It’s hard to imaging that people working on emissions cheating would have been less likely to work on this, had they only taken the CS ethics class.
- bradstewart 8y agoCertainly not. But they can help sway people who are on the border to the ethical side of things. Ethics classes can also provide tools and mental models for dealing with gray areas which aren't as cut and dry as cheating on an emissions test.
- grasshopperpurp 8y agoYes, and the the thing is that most people are "on the border" - that is to say, little more than a product of their environment (speaking of their actions/attitudes, not their worth as people). If you teach an entire population ethics (assuming it's done well and everything that comes with that), you will still have your 5-10% of rotten apples, just as you'd have 5-10% who would seek out ethics on their own. The big difference will be in the 80-90%.
- gnulinux 8y agoMost engineering schools have classes about engineering ethics. When I was an undergrad in UC Berkeley, we not only had an ethics class (called "Social Implications of Computing") but also every single class had ethics sections, e.g. if you're working in a mission critical OS don't forget what happened to Therac-25, if you're writing ML Algorithms don't forget what happened to Uber etc... These were actual parts of classes, mentioned by professors. I think ethics is a very important part of both engineering and being a human being. You cannot make bridges and not be responsible if they collapse. You cannot make an OS and not be responsible if a bug kills bunch of people. Similarly, you cannot write fraud software and go by your day because that's what your boss ordered you to do. Engineers are highly skilled workers and we must have enough consciousness to deny doing a job if it's not ethical. Otherwise, it's just banality of evil.
- mark212 8y agothis is very encouraging to read, thanks for this comment
- quiq 8y agoI had a similarly titled class at a no-name state school. I think the professor mentioned something about ACM recommending/requiring the course, so it should be pretty widespread. On a more discouraging note, there was normally single digit attendance out of triple digit enrollment in the particular course I took. I'd say average engagement was ~6 hours total over the course of the semester... Including a movie. I don't know anyone that didn't get an A. There were a few from that class that went onto big names, and they weren't among the regular attendees.
- Jach 8y agoI think some sort of ethical component to the degree is required for ABET accreditation. My CE degree was retroactively accredited so I'm not sure if current students have to take a separate class, but one of the changes that was made while I was a student and the ABET process was happening was that we spent some amount of time in our project courses' lecture time (each semester has a 5-credit project course) covering ethical issues. ACM/IEEE membership (which itself, or at least "membership/sponsorship of a professional society by the school", might have been part of the accreditation requirements too since we all joined IEEE) may impose additional requirements like discussion on ethics. I think the general point stands though that for everyone calling for ethics classes -- a lot of CS and CS related degrees like CE already have them. Furthermore many companies already have various code of conduct types of annual training. The solution has to be something else than "education".
- jasonmaydie 8y agoThe implementation of this cheating is more insidious than you think. There could be a requirement to put in a "simulation" for testing. There's nothing unusual about implementing this feature. Then another request comes in at a later time to make this feature a build setting. Then at a later time someone who is not a software engineer toggles this build setting on production build during manufacturing to put it out in the field.
- Verdex_3 8y agoHear hear. When building a bridge it's obvious when they're building a test bridge or a real life bridge for people to drive over. "So you want to spend 100 million dollars on a bridge that you're only using for testing purposes. And you want to put this bridge right where it would be really useful to put a real bridge to handle rush hour traffic. And you have a deal with the city to collect toll payments for this 'test' bridge for the next 50 years. Yeah, I don't think we're going to be cutting any corners for the 'test' bridge." VS "You want me to take 2 hours to add in a test feature that can be conditionally compiled in for testing purposes? Also I talked to John in testing and they actually want this feature for testing. Seems legit." Two months later. "Hey, I found this test feature that would allow us to cheat on the regulations. All we have to do is set this compile flag to true. The programmers even made this neat UI that allows us to change the build configurations without having to talk to them."
- cmiles74 8y agoIn addition, I think it's much easier to go back into the field and examine a bridge to ensure that something important was constructed to the specifications that you required. This is not the case with most of the software people write, certainly in this case it's pretty difficult for a developer to pull a car of the production line and verify that the code they wrote made it into the car without any changes.
- lagadu 8y ago> but active in fraud. No we're not. We don't have societies that put any such responsibility and restrictions in place, along with benefits, for what we do. Whatever the company does with the code is the sole responsibility of it. Like you said, other engineers have LEGAL obligations, what makes an obligation moral or not is extremely debatable and always subjective to the point of uselessness.
- na85 8y agoAre you suggesting that ethics and morality are useless, and that software developers should not care about them?
- Verdex_3 8y agoNo, he's saying that if he raises an objection, then his boss will fire him and find someone less competent to do the job. Then after he's fired for standing up for the good of society, society will tell him to starve to death because he doesn't have a job. Finally, his replacement will do a significantly worse job and the result will be greater damage to society.
- danharaj 8y agoThis is why unions exist.
- lostcolony 8y agoThe -idea- of unions. They're not exactly in a strong place in the US.
- jessaustin 8y agoWhen has a union in this context ever protected a member who refused to take action on behalf of the business for ethical reasons? Lots of unions protect inaction motivated by worker safety, but this is a different thing.
- ken 8y ago
- kolbe 8y agoI understand your sentiment, but I think this only applies if you want to be an especially good person. The rest of the professional world does not have to match such a high standard of ethics, and as much as I would love for everyone to have to behave nobly, it's pretty unreasonable to ask software engineers to report software that exploits loopholes in regulations while our counterparts in banking, private equity, law and medicine basically live exclusively off of doing that. edit for the downvoters: in this exact case, the executives of the companies hacked the system, their lawyers probably approved of it, and the strategists who conceived of it likely used to work as investment bankers. And yet, the software engineers are the ones expected to take the high road?
- EpicEng 8y ago> while our counterparts in banking, private equity, law and medicine basically live exclusively off of doing that. Literally every one of those professions are governed by legal ethical requirements. Software engineers/devs are not, which is kind of the whole point.
- kolbe 8y agoPE doesn't any more than programming. Banking's laws are just moats for the established players masquerading as regulations. Law has them, but in a strange twist, their ability as lawyers make it so that they don't matter. And medicine is too complex for me to really comment, but from my vantage point, it looks like they're free to be scumbags so long as they claim they won't be when they get their degree. But every one of these are largely just regulated by the idea that if you're too big of a scumbag, the feds will nail you for wire fraud. That seems to be the only real rule of law or code of ethics we have in the professional world. And software engineers have to obey it as much as everyone else.
- EpicEng 8y ago>>PE doesn't any more than programming. Banking's laws are just moats for the established players masquerading as regulations. PE sure, I probably should have noted I know little about that, but when you talk about banking you're now going from "have no ethics laws" to "well, they exist, but they're not effective in my opinion." >Law has them, but in a strange twist, their ability as lawyers make it so that they don't matter Lawyers get busted on ethics violations all of the time. My mother is a lawyer and for a short time I worked as a pseudo legal secretary in a mid sized city. I recall numerous lawyers being disbarred for ethics issues. I have no idea what the real numbers are, but I don't think you do either. >And medicine is too complex for me to really comment, but from my vantage point, it looks like they're free to be scumbags so long as they claim they won't be when they get their degree. So you don't really understand the issue, but you've heard some stuff on the news and maybe from friends, so you write the entire things off. How about civil engineers who are personally liable for their work? >But every one of these are largely just regulated by the idea that if you're too big of a scumbag, the feds will nail you for wire fraud. That seems to be the only real rule of law or code of ethics we have in the professional world. And software engineers have to obey it as much as everyone else. Again, moving goalposts. If you don't feel the current regulations wrt doctors, lawyers, and bankers are enough, fine, many would agree, but that's not the issue here.
- cornellwright 8y agoThe other thing I'd add to this is if you look at the VW and other scandals, you'll see "rogue engineers" are the first ones executives will try to throw under the bus. Ethics aside, you're taking a huge risk in order to inflate someone else's bonus. In the end if things go sideways the company won't have your back. That boss who told you to cheat (verbally of course) will suddenly have "no recollection" of the conversation.
- cmiles74 8y agoYes, I don't think this is the way it actually played out. As you mention, why would such a "rogue engineer" take such a risk for someone else? And why would that person risk sharing their culpability with a "rogue engineer" when I am sure they could phrase things in a way that sounds more innocent and reasonable.
- cornellwright 8y agoSure, it won't be phrased that way and so obvious when presented. But I guess that's my point: Have a conscience, pay attention, and don't build anything illegal or unethical. Management may be sanctioning it now, but they won't have your back once the music stops.
- rusk 8y ago> why would such a "rogue engineer" take such a risk for someone else? It's well documented that people will often defer to authority, even if it's to do something they feel uneasy about [0] Indeed, in my own experience as a younger engineer I had a manager sitting over my shoulder once dictating what I should but into an estimate, under my name. Indeed it was fairly innocuous stuff, and I'm sure he meant well, but still ... In a business environment where you have all sorts of contractors, graduates, people floating through and a management culture of "getting things done" there are so many ways that this kind of thing can happen. [0] https://www.simplypsychology.org/milgram.html https://www.simplypsychology.org/milgram.html
- dorgo 8y agoAs a rougue engineer I would expect at least an increase in my bonus which is proportional to the one of my chef. There is little reason to be a roughe engineer otherwise.
- logfromblammo 8y agoI can't force my ethical standards onto an unethical employer without the help of a union, or at least a professional organization able to advocate for me. Employer: Do this vile thing. Me: No, that would be unethical. Employer: Oh, you're right, of course. Train Steve instead. Me: Okay. [later] Me: Steve is trained. Employer: Great. You're fired. Steve, do this vile thing.
- ISL 8y agoThere is another option. Employer: Do this vile thing. Me: No, that would be unethical. Employer: Oh, you're right, of course. Train Steve instead. Me: No. <quits>
- logfromblammo 8y agoSo you always quit when asked to train someone? The reason Employer plays along in the beginning is so you don't realize Steve will be your replacement until it has already happened. Besides that, some people will need to continue working as they search for another job, and training Steve could be parlayed into a rudimentary supervisory position on the resume. That helps if you ever intend to jump over to the developer-manager track. Q: "Have you ever had anyone under you?" A: "Yes. I was in charge of a trainee once." Q: "How did that work out?" A: "Great, until they gave him my old job, then fired me. Maybe we had a budget problem?"
- Verdex_3 8y agoAdditionally, if you don't train Steve and instead just quit, that's not going to stop the Employer from asking Steve to do the unethical thing without training. Now the unethical thing is not only unethical, but it is also filled to the brim with bugs that cause unsafe situations for end users.
- mark212 8y agodon't give up so easy. Think of Fair Trade coffee -- all it takes is a vocal minority to insist on a set of practices and that will come to be considered the norm. The social (and market) pressure of hiring only coders that have taken the "Oath of Shannon" or whatever will enforce the standards far better than any union.
- arendtio 8y agoWell, AFAIK it weren't the VW people who build the cheating system and the ones who built it, pointed out that in some countries it might be illegal to use it. The VW people just decided (probably a manager) to activate the cheat system. So I am wondering where an ethical standard could help in that chain. If you build international products its kinda hard to know every law on this planet and refusing to build something, just because someone could use it in a country where it is illegal to use it, could become very complicated very quickly. I think the simplest solution would be to improve the test methodologies and maybe increase the penalties.
- wlll 8y agoThe cheat device that the VAG group added wasn't really in any sort of grey area. This isn't like the wrong shape steering wheel, or accidentally too small wing mirrors. This was a deliberately programmed system for cheating on emissions tests.
- deleted 8y ago[deleted]
- deleted 8y ago[deleted]
- dsfyu404ed 8y agoEthics isn't that simple. The tools need to exist and some people will use them for things we don't agree with. The emissions software needs to be able to turn things on and off because the emissions requirements for certain jurisdictions and applications can be mutually exclusive. It just so happens that manufacturers flip switches they souldn't in order to fake compliance. I've worked on software that can be used to make it much easier to drop a bomb on you. The main purpose of the contract was a software package for defensive applications (i.e. making it much harder for a car bomb to surprise a checkpoint). Should it have not been built because it has the potential to do things you or I might not agree with?
- cmiles74 8y agoI wholly object to this line of reasoning. I don't see how this wouldn't blow-back on software developers and make them an easier scapegoat. Take these car manufacturers gaming the emissions test, for example. I find it very easy to imagine management making a series of requests for changes to the software that seem innocent but allow for this exact outcome: changing the way the system performs when being tested for emissions. They may have asked the development team to add some kind of a switch so that they could toggle the behavior on and off in order to assess how overall performance was impacted. That sounds innocent enough to me that I wouldn't be eager to risk my job (and perhaps the ability to get work in the future) over suspicions. Certainly it's not enough that I'd try to get law enforcement involved. This idea that software developers (or engineers, if you prefer that term) should be responsible for the entire system, even though they likely only work on one component, sounds to my ear like nothing more than setting those developers up to be easy scapegoats. If you wanted to get me on board in any way, I'd need to see some system where all code is signed and, perhaps, stored in some tamper-proof write-only storage system managed by a third party. I'd need to be able to verify beyond any doubt that code a particular developer wrote hasn't been tampered with before I'd be willing to send that developer to prison, or at the least, ruin their career. Management is at fault for requesting the feature that enabled them to game the system. Management should pay the cost, I see no reason to cast any blame on developers. I have yet to see any compelling evidence that the developers knowingly added code specifically to game the system. If evidence of that is out there, I would be super interested in reading it and would appreciate any links anyone might have.
- geodel 8y agoYou are right. From what I have seen that most of the time even quite senior engineers are not aware of larger implications beyond technical architecture of software they are developing.
- Zimahl 8y ago> I find it very easy to imagine management making a series of requests for changes to the software that seem innocent but allow for this exact outcome: changing the way the system performs when being tested for emissions. Off the top of my head, I've written many pieces of code that 'game the system' but are used only for testing purposes. I know full well that if those pieces get into production they could be hazardous, but there is nothing ethically wrong with me creating them. If a superior takes that code and uses it, that's not my fault. It would be supremely easy for management to put in a bunch of requirements for the VW emissions system that are blatantly dangerous, but 'for testing purposes'. The developers need to be able to trust the higher-ups and certainly shouldn't be held responsible for their decisions.
- pweissbrod 8y agoNobody told me about the code of ethics I have. Can you send me a link? Is it somewhere in the windows 7 EULA I can never get myself to read those darn things :)
- robdachshund 8y agoWell in this case it was factory testing and had nothing to do with software. In the case of VW, I highly doubt those software engineers were told plainly what they were doing. While I agree they have an obligation also keep in mind speaking up would probably be career suicide. The liability is on the executives that make take these illegal actions.
- bitL 8y agoThese things are pushed by management down, rarely from engineers upwards. The usual "solution" is to hire people from different cultures with lax laws, i.e. in WEU it's popular to hire EEU folks, in USA to hire Indians to do the dirty job, as they either don't understand the legal consequences or are from cultures used to "work around" laws.
- flashmob 8y agoCounterpoint: Software engineers can just make it a configuration option and leave it to the user to decide how it is run. Unlike civil engineers who can't build a bridge with a configuration option for a 'light & unsafe' bridge, software engineers can make everything an option, and that's often the best practice. Of course, assuming that they are unaware of how their user / client / employer will actually use the software, they should be fine.
- Jach 8y ago"It should be noted that no ethically-trained software engineer would ever consent to write a "DestroyBaghdad" procedure. Basic professional ethics would instead require him to write a "DestroyCity" procedure, to which "Baghdad" could be given as a parameter." --Nathaniel Borenstein It's kind of hard to disagree...
- thebluehawk 8y agoTrue, no ethical engineer would write "DestroyBaghdad", but how about perfectly reasonable "set custom threshold for test" function that lets the client pick? And then the client chooses an unethical value.
- abraae 8y ago> We are writing things that affect peoples lives. That could kill people. That affect the environment. We need to hold ourselves to the same moral obligations as other engineers. We have a duty to prevent harming people when we write our software. High and mighty ideals, but come on. If you're working on software for a medical device, then yes. But on another post today it was pointed out that crypto currencies are burning more electricity than Iceland. That's straight out environmental vandalism. Is everyone involved in crypto expected to down tools, cos ethics?