3 ms·
Software doesn't "apply" rules, humans do that. Yes, the software may be part of the apparatus of a cold unfeeling bureaucracy (private or state), but it is th
by PaulDavisThe1st 4y ago
Software doesn't "apply" rules, humans do that.
Yes, the software may be part of the apparatus of a cold unfeeling bureaucracy (private or state), but it is the decision of human beings to accept its output that causes the damage.
I should have probably dropped the term "sentience" - I agree it is not really relevant. I will need to think about examples like Therac-25. Not sure how that fits in my ontology right now.
- ben_w 4y ago> Software doesn't "apply" rules, humans do that. I think you're using at least one of those words very differently than me, because to me software is nothing but the application of rules.
- PaulDavisThe1st 4y agoWhen a software system says "this person must have their property foreclosed", it is following rules at several levels - electronics, code, business, legal. But ultimately, it is a human being that makes the choice to "apply" this "rule" i.e. to have consequences in the real world. The software itself cannot do that.
- ben_w 4y agoThanks, that clears up which word we differ on: "apply". With your usage, you are of course correct. Given how often humans just do whatever they're told, I don't trust that this will prevent even a strict majority of possible bad real-world actions, but I would certainly agree that it will limit at least some of the bad real-world actions.