3 ms·
I love the narrative this starts off with! But, solutions... I don't see how professional ethics could actually be applied productively. And I say this as some
by mindslight 9y ago
I love the narrative this starts off with!
But, solutions... I don't see how professional ethics could actually be applied productively. And I say this as someone with an engineering background.
If a company's business is building bridges, ethics are an orthogonal concern and hence relatively straightforward to apply. But how could a civil engineer productively apply their ethics to a company who's business it is to build concentration camps? Making sure corners aren't being cut doesn't really address the problem! If it is just one company building camps in a far off land, then sure a review board can apply judgment and sanction their employees from the rest of the industry. But if your domestic society shifts to where building camps is an upstanding economic sector...
Essentially all of the funding for consumer software is based on the assumption of surveillance, period. Low marginal costs means investors desire home runs. Metcalfe's law means the introductory price has to be free. Success means users end up locked in - so even if the consumer-facing front end manages to be profitable on its own, the back end is still able to add to profit through surveillance, or at least store everything until they figure it out.
Even business sectors that should be outside sources of non-surveillance development seem to prefer sitting on the sidelines. For example, it would be pretty straightforward for banks to start offering direct public APIs for customer access to accounts, letting users choose which software they'd like to trust with such data. And then even, as an outside authority, putting restrictions on service providers about data retention. But instead the banks stonewall, and so we get surveillance-service providers like Yodlee filling the gap.
I don't really have solution per se. On a different day I'd go on about end-user Free software. But that's clearly outcompeted for the reasons listed above. When is the last time you saw a GNU TV commercial?
- scribu 9y ago> But if your domestic society shifts to where building camps is an upstanding economic sector... Is that the case, though? It seems to me that in the last few years the tone has shifted in the opposite direction, where even the mainstream is starting to question the overall utility of social networks and other surveilance-filled software.
- mindslight 9y agoTalking sure. But has any of this effectively shifted the investment focus? Founders have not wanted to be creating surveillance-based companies the whole time. The standard course is for that functionality be added afterwards for monetization. In order for the engineers' ethical judgment to have mattered, they had to have prevented this change a priori by designing the software to treat the future company itself as an attacker. This is very expensive.
- racer-v 9y agoYes exactly. The direction he takes his line of thought in the postscript - expelling individual members of the engineering profession for unethical behavior - is fatuous. The big trends are driven by big money: which business models and technologies get funding. It's not the engineer whose bug accidentally irradiated a patient that's the problem; it's the VC's investing billions in spying on and shaping human behavior.
- WorldMaker 9y agoProfessional Ethics often can't stop companies from being evil (that's for government regulations, sort of, mostly), but they can help individuals stand up against such companies. Most such codes of ethics such as American Society of Civil Engineers Code of Ethics [0] or even the Association for Computing Machinery's Code of Ethics [1] are written to the individual first as a part of your relationship (membership) to the larger society. Most of the actual effective power of such an organization in an ethics violation is to remove its relationship (membership) with an individual that breaks its code of ethics. In a field like Civil Engineering this has bite because few respectable, non-evil companies are willing to hire Civil Engineers that aren't members in good standing of the ASCE. When was the last time a software job interview asked if you were a member in good standing with the ACM? (Sigh, imagine if that saved you a bunch of time in that job interview, as a civil company wouldn't bother asking an ASCE member a laundry list of basic job knowledge.) In terms of collective action, the professional society/association can help. If a civil engineer refuses to do a job, or whistleblows on a job in progress, due to it being a potential ethics violation the society (because it is not a union) cannot prevent that particular employer from firing the engineer, but it can: A) make sure that the firing is less of a black mark for other employers by making that information transparent and available to future possible employers, B) notify the remaining members at that company that they may be involved in an ethics violation which could result in loss of their society membership, C) notify potential candidates to that company that the company is involved in ethics violations. Sometimes that collective black list of "no respectable engineer will work for you" can be enough of a deterrent for a company to be less evil. So Code of Ethics are a good step, if you have an association/society with some bite that would apply if they kicked you out as a member. They can sometimes leverage that collectively for overall good. Organizations with further more bite are Unions, which can and do set contractual terms with employers that can force the company to adopt the Unions' ethics, and Governments, which can and do set regulations that are the closest we have to enforceable ethics terms on companies because Governments in the worst case have armies with which to enforces them. Pulling it more specifically to your worries about surveillance, it seems to be almost directly addressed in ACM's Code of Ethics section 2.1. We've established that ACM doesn't have much bite in the tech sector, however, as employers mostly don't care about ACM membership. It would be interesting to see someone try to unionize software developers with a goal of promoting non-surveillance as a first principle, but software developers mostly don't seem to want to unionize because they see themselves as white collar and above such concerns as collective bargaining. (Despite many of Hollywood's unions being quite white collar and proving collective action can be essential, but I digress.) That mostly leaves government regulations. Data and Privacy are certainly things that governments could regulate, given they were shown a clear enough need, but also unlikely in certain political climates and by those that passionately are against regulations, even those designed to enforce ethics and protect privacy. [0] http://www.asce.org/code-of-ethics/ http://www.asce.org/code-of-ethics/ [1] https://www.acm.org/about-acm/acm-code-of-ethics-and-professional-conduct https://www.acm.org/about-acm/acm-code-of-ethics-and-profess...
- webmaven 9y ago> But how could a civil engineer productively apply their ethics to a company who's business it is to build concentration camps? You don't even need to make the example that extreme. How about architects, structural engineers, civil engineers, etc. all working to design and build for-profit prisons that are intended to incarcerate a large fraction of the population? Or how about food engineers working to create snacks - of questionable-at-best nutritional value - that are ever more addictive?