5 ms·
'“It’s always going to follow the rules, I mean, almost to a point where human drivers who get in the car and are like ‘Why is the car doing that?’” said Tom Su
by jerf 11y ago
'“It’s always going to follow the rules, I mean, almost to a point where human drivers who get in the car and are like ‘Why is the car doing that?’” said Tom Supple, a Google safety driver during a recent test drive on the streets near Google’s Silicon Valley headquarters.'
This is a drum that, like privacy and encryption, we techies need to start banging hard before it's too late. The fact that laws are fundamentally limited by our abilities to enforce them, and that laws are fundamentally written to be enforced by humans with some discretion, is such a deep assumption for us that we don't see it. We irrationally tend to conceive of a law that says "It is a felony to wear your hair in a ponytail on a Tuesday" as an absolute, even though what it really means is "If a police officer spots you with your hair in a ponytail on a Tuesday, and by their discretion arrests you, and at the discretion of a prosecutor charges you, who at the discretion of a judge and jury convicts you, you will be guilty of a felony." All laws actually say that, but that's not how we humans speak or conceptualize them. Also note the importance of a human even spotting the violation in the first place.
So, naturally, when we get technology that can rigidly enforce law, we don't program them with the "real" law, we program them with the text of the law. But the truth is, the text was never passed as a law. When the law was deliberated, everybody was really deliberating the version that involves all the human discretion, and prior to the introduction of computers, the law that was really enforced was the one with all the human discretion. A rigidly-enforced-by-computer law is a fundamentally different law, in the most concrete way possible; actions that you would never have been penalized by the human law result in immediate penalty in the computer world. There's no more concrete way to prove the point that it is a fundamentally different law.
We CAN NOT simply translate the text of the law into computer programs. If we are going to do computer enforcement of laws (and I'm going to drop the question of whether that's a good idea, feel free to debate in replies), we must write new law. By that, I do not merely mean that society has an obligation to write new laws, but that the very act of programming a law is writing a new law into existence, one never deliberated by the processes of democracy. We literally can not simply translate laws into programs. It is impossible. The result is not the same law.
- qntty 11y agoI think you're onto something that a lot of people don't understand or don't buy into
- rasur 11y agoThis. A Million times this. However I fear the subtlety will be lost on the majority, as we continue to construct our own cages around ourselves.
- danharaj 11y agoMost people are given a very, very stupid idea of what the law is from the very same institutions whose authority is derived from the law being treated as a real object external from human subjectivity that has real power over humans. An education that provides a realistic comprehension of laws and how they really work is dangerous; demystifying legal power and demystifying politics makes for a conscious, more autonomous body politic. Let's not blame people for their cages: The cages were put up while they were least able to contest them.
- wereHamster 11y agoOTOH, if you start applying the law to the letter as it is written in the books, you'll quickly see how stupid certain laws are. And here stupid could be anything from not enforcable without arresting everybody, inconsistent, contradictory, etc. Think of it as formal verification of the law. The result, in turn, you can show to politicians or the people and convince them to change it.
- olalonde 11y agoI'm playing the devil's advocate here but another alternative would be to write laws that are meant to be literal and enforced 100% of the time.
- geofft 11y agoThat doesn't serve justice, unless you have an actual way to enforce those laws 100% of the time. Theft is illegal, but there are ways for a rich banker to steal money that are undetectable, whereas a man who steals a loaf of bread to feed his family is much more obvious.
- vezzy-fnord 11y agoThis is already the case for the ones where such a quality is relevant. Enforcement is a separate duty from penning legislation, and so will come with its own discretions that may lead to situations where certain laws are enforced with a lower priority because of a lack of practicality.
- ihsw 11y agoHuman discretion is the bedrock of modern legal systems across the world -- at the risk of inappropriately quoting an aphorism on HN, there are exceptions to every rule. Such exceptions are sometimes codified in law, but the idea is that our legal system is based on trust rather than technical correctness. Not only do we defer judgement to a jury of our peers rather than rigid and uncompromising interpretation of the law, but we trust that all levels of government (judicial, executive, legislative) will act in our best interest rather than the letter of the law. What you're proposing would require broad-sweeping revisions to all manner of law.
- krapp 11y agoThat's basically a form of authoritarianism. Also, this is essentially the underlying premise behind no-tolerance policies and three-strike drug laws with mandatory sentences, which view interpreting the law based on context as an impediment to enforcement, the solution for which is removing the ability of judges to do so. You can't have a just legal framework in which the only role of humans is to be punished or to exact punishment.
- tclark225 11y agoI definitely agree with this, but how could you specifically change the laws in this case such that they are still, by some measure, "fair" and "just"? Most people would probably agree that there is no reason to adhere to the letter of driving laws all the time. Speeding on an empty highway to get somewhere more quickly is mostly harmless. Running a red light in a dangerous neighborhood might be safer than waiting. To the point of the "real" laws, such violations are probably most often prosecuted when they result in danger to the driver or others. You could certainly generalize these examples from driving to a variety of other laws. I guess the question is, you can beat the drum about this, but to what tune? What's the answer? How could a self-driving car decide when it is okay to break traffic rules without a certain level of human discretion? How could the laws be re-written such that the effect is the same?
- Retra 11y agoYou'll want to encode enforcement rules in the laws themselves. Fundamentally, our laws really aren't constraints on what you can do, but guidelines for what you can enforce. You need to take it a step further and write down what you will enforce.
- danharaj 11y agoHow do you guarantee the enforcement of the rules of enforcement? The fundamental problem is a vicious circle. The abstraction of law leaks.
- Retra 11y agoEvery abstraction leaks. That's why they are abstractions and not 'actuals.' What you do is try it, and when it fails, you manage the failure and modify your system.
- danharaj 11y agoDifferent people have different idea what the actuality of law is. Most people (as Baudrillard would argue) don't ever work with the actuality. Others, mainly the powerful, are quite happy enough to fix failures of the law with copious amounts of force. The abstraction tends to leak bullets. It is very important to emphasize that the law is less than sacred, even an annoyance, to undermine those who will enforce it with the wrong actuality.
- CWuestefeld 11y agoI think there's a lot of truth to what you're saying, but it's more complex than that. When considering legislation and regulation, we willingly juggle a lot of cognitive dissonance. We seem to divide plan into (at least) its implementation and its intended effect, and consider each of those separately. So I'm endlessly having conversations with friends of a different political stripe (which is easy, since everyone is of a different political stripe than me) that go something like: (note I'm not trying to trigger the implied political debate, this is for illustration only) Friend: Financial system bailouts and systemic risks of "too big to fail" are terrible, and so we can't touch the Dodd-Frank legislation. Me: I know that supporters of Dodd-Frank promised that it would put an end to TBTF. But the bill doesn't actually contain anything that does that. And in fact, since the industry has further consolidated since the bill was passed, it shows that whatever the intent, it isn't able to do its job successfully. If it can't do what you want it to do, why should we keep it? Friend: But the banks are out of control, and we need to do something to prevent another collapse. We can't remove any regulation on them! Maybe this is just the normal voter ignorance effect, but it seems that we assume people are making decisions based on actual understanding, but they're really just using oversimplified proxies instead, even when the inaccuracy of their proxy is pointed out to them. So a law that purports to fix X (whether X is healthcare or immigration or whatever) is a necessity, regardless of what the actual evidence, whether empirical or from reading the bill, tells us. TL;DR: passing a law is intended to make us feel like we're doing the right thing, not necessarily to actually do it.
- chrismcb 11y agoIt seems to me that this is less about "following" the law, and more about being safe. The car that was rear ended might have stopped for any number of reasons, the tailgater is going to hit the stopping car. And the google car actually didn't follow the letter of the law at the 4 way stop. It also has been programmed to wait for others, in case they are breaking the law. If everyone followed the law 100% everyone would be safer. I'm not saying the laws are perfect, but the issue discussed here is more about what the self driving car is doing that isn't covered by law