10 ms·
I really hope that Uber's shenanigans get studied in ethics classes in Computer Science and other technology degrees. When I was doing my CS degree, we had a m
by freedomben 10y ago
I really hope that Uber's shenanigans get studied in ethics classes in Computer Science and other technology degrees. When I was doing my CS degree, we had a mandatory ethics class (which I hated at the time but in hindsight think is a good thing). Ethical implications were something I hadn't previously thought of much, but in the field I've encountered them many times.
Based on the news that has been coming out from Uber, I think it's time for our industry to re-focus on the ethics of what we do. Being technologically cool, doesn't make something good.
- DaiPlusPlus 10y agoMine focused on Therac-25... not quite the same problem-space. It's possible Uber's devs were misled about the nature of the software they were writing - for example I read their other secret system, "Greyball", was written under the guise of protecting Uber drivers from being physically assaulted by militant Taxi drivers - a common sight in certain parts of the world - nothing to do with the dual-use of shadow-banning public officials and journalists.
- rosstex 10y agoAre you from Berkeley?
- alpha_squared 10y agoMine also focused on Therac-25, but I'm not from Berkeley. It's likely that it was used throughout several campuses. Though I feel that's not so much about ethics as it was appropriate safeguards/testing given the problem space.
- jrockway 10y agoI think it's a pretty common ethics case study. Therac-25 almost seems like a meme to me these days: "What are the ethical implications in the field of software engineering?" "Therac-25." I don't think we've gotten any better, either. I'm surprised there aren't thousands of Therac-25s killing people every day, actually. I guess the hardware engineers got better at turning off software, because I don't think software engineers got better at software engineering.
- Gibbon1 10y ago> I guess the hardware engineers got better at turning off software, because I don't think software engineers got better at software engineering. Years ago (like 25 years) I read an author discussing safety critical system. He flat out said, safety must be a primary system level design goal. Attempts to band aid it in will fail. Properly designed systems have safeties, interlocks, and monitoring subsystems to prevent software bugs from propagating to the point where people are harmed. People designing safety critical systems tend to completely distrust software.
- bipson 10y agoHuh, I think I never heard of the Therac-25. We instead talked about flight Lufthansa 2904 [1] (Airbus A320-211 Warsaw accident), also as a case of overconfident engineers (although Wikipedia mostly blames the weather report). [1] https://en.wikipedia.org/wiki/Lufthansa_Flight_2904 https://en.wikipedia.org/wiki/Lufthansa_Flight_2904
- noir_lord 10y agoTherac-25 featured on our syllabus here in the north of England. Its a pretty infamous case.
- DaiPlusPlus 10y agoThe "ethics" aspect came from the conduct of the engineers behind Therac that did not take the reports of malfunctions seriously, including a fatality - they were too overconfident and arrogant - as a result it took 2 more people to die, and many more seriously injured, before the problem was identified and fixed. We also covered other ethics-related case-studies that covered project-mismanagement leading to massive cost-overruns, especially of public-service projects - particularly when those overruns are caused by malfeasance instead of incompetence or ever-changing client requirements (e.g. embezzlement, fraudulent conduct, etc). Another one was the ethics of personal data collection.
- TuringNYC 10y agoTo loop others in: Summary: https://en.wikipedia.org/wiki/Therac-25#Problem_description https://en.wikipedia.org/wiki/Therac-25#Problem_description Full Reading from Berkeley course: https://www-inst.cs.berkeley.edu/~cs61a/reader/Therac-25.pdf https://www-inst.cs.berkeley.edu/~cs61a/reader/Therac-25.pdf
- stass 10y agoWhat's unethical about this? They were doing market research. It's not much different from stalking your competitor on google and going after the users they advertise to.
- jsmthrowaway 10y agoIt's completely different, so far different as to be antonyms, opposites, completely diametrically opposed ends, because you just described a passive, orthogonal, ethical activity while Uber actively fooled with Lyft's systems to get the intel they wanted (emphasis mine): > Hell originated after Uber created fake rider accounts on Lyft and used software to trick Lyft’s system into thinking those riders were in certain locations. This allowed Uber to see the eight closest available Lyft drivers to each fake rider. You literally just typed the equivalent of "what's wrong with using an ad unit to deliver a zero day exploit? It's not much different from advertising."
- JustSomeNobody 10y agoAll of which /u/stass would have know had there been an ethics class for them to take. ;)
- stass 10y agoThere isn't the one and only standard for ethics. Perhaps a class would teach a certain version of ethics, but not a universally applicable one. As a somewhat relevant example, a lot of ethical norms in USSR (prosecution of successful individuals, outlawing free speech, destroying dissent, banning "unethical" literature and works of art) would be considered completely unethical in the Western society and vise versa, although the admiration of former became fashionable in tech circles lately.
- _jezell_ 10y agoCreating fake accounts is pretty common for spiders... standard search engine tactics.
- viraptor 10y ago
- watwut 10y agoI don't think it is lack of ethical knowledge that makes people act unethical. It is that being consistently ethical costs and may have bad impact on your career. It is also that company like Uber would punish overly ethical people too much and would pish them out. Ethical class won't solve that.
- m_t 10y agoEthical class might help a young developer understand why working at a company like that is a bad idea. Understanding that a company punishing you for being ethical is a big glowing red flag is important.
- thewhitetulip 10y agoYes, but the problem is that Uber pays well and it has a lot of interesting problems to solve, and as usual in our society, morality becomes the later priority than interesting work/pay
- spcelzrd 10y agoIt's not a problem limited to our society. Ethics, regulations, and consumer pressure can all help to keep corporations in check. The thing to remember is that a corporation can never have a moral compass, so we have to give it to them.
- cjrp 10y agoBut if there was the potential for future prosecution because of your actions, maybe that would alter the risk/reward profile enough for some people? Especially if you've taken an ethics course, and thus can't really argue plausible deniability.
- wfo 10y agoIf developers had a professional organization and working for Uber (or some company that does things which are banned by that organization) was a black mark on your resume that would ensure you never get a good job again, then we'd be in business. That's how it works for doctors and lawyers.
- astrodust 10y agoSince we all learned so much from Enron and ethical problems like that never cropped up again, stands to reason Uber's going to be the last of its kind.
- asdfologist 10y agoSorry I can't tell whether this is sarcastic.
- woodruffw 10y agoI've been designing a CS ethics class for the past few months, mostly as a personal challenge. I proposed it to a few professors in my department yesterday. The responses I got were mostly variants of "not until they make us," which is exactly the kind of attitude that results in our present state of affairs (thinking of the BMW emissions controversy, Uber, &c). I don't want another major teachable scandal to come out of the tech world, but that may be what it takes.
- toss1 10y agoIt was VOLKSWAGEN --NOT BMW-- that created the emissions scandal by programming their cars to change the engine running parameters when the detected the conditions of the emissions test. first article found of 641000 http://www.bbc.com/news/business-34324772 http://www.bbc.com/news/business-34324772 BMW is actually doing it right http://www.bmwblog.com/2016/02/16/top-five-current-diesel-bmws/ http://www.bmwblog.com/2016/02/16/top-five-current-diesel-bm... sheesh (edit: add BMW story link)
- neoeldex 10y agoThat's not true, All car manufacturers were pulling tricks in order to save adBlue. The BMW story is on a bmw blog... Here you can see other emissions, in a Guardian article, where it's clearly to be seen that BMW does not comply to the EURO 6 norms. https://www.theguardian.com/business/2016/apr/21/all-top-selling-cars-break-emissions-limits-in-real-world-tests https://www.theguardian.com/business/2016/apr/21/all-top-sel...
- toss1 10y agoPerhaps the Guardian story is true and everyone is playing around the margins on the European tests, but that's trying to obscure the forest with one tree. In the actual context of the comment, which is the the USA "emissions controversy" with the massively fraudulent code, it was VOLKSWAGEN that was the main player, BMW was not involved. (also IMO, Diesels are a pretty bad way to burn fuel in any case; I don't think BMW should pursue it at all, and although I like my petrol-powered model, I wouldn't buy one of their diesels)