3 ms·
You're right, of course, but as you say a lot of what we see in the show is for the sake of the drama. I think there's no way to put the genie back in the bott
by carapace 12y ago
You're right, of course, but as you say a lot of what we see in the show is for the sake of the drama. I think there's no way to put the genie back in the bottle when it comes to our technology enabling ubiquitous surveillance: How can you be sure that everyone is obeying policy (around how to use the collected info) unless you have a surveillance system to watch them in the first place?
It doesn't matter what we think the policy is if we can't control the "root" of the system, and we can't be sure we control the "root" without being able to check on people (ourselves) to make sure they haven't somehow wrested control from us.
"Trusting trust" gets even more crucial once nanotech starts to hit.
I don't like it but as far as my analysis has proceeded I can only imagine a humane-but-totalistic system being workable, and the best most widely-known image of such is (I think) Star Trek. ;-)
- krapp 12y agoI'm not entirely sure I agree with the premise that ubiquitous surveillance is unavoidable and unstoppable. To me, that attitude seems half like a cynical cop-out and half cyberpunk wish-fulfillment. No infrastructure which requires as much complexity and cost and effort as that does, is immune to political, economic or societal forces. Already, you can begin to see pushback from other (many themselves) government and some companies like Apple, who both may be genuinely bothered by government intrusion and see "privacy" as a near-long-term necessity for selling products domestically but more importantly globally. It's true that Facebook is creepy, but it's also true that people have known that Facebook is creepy for years now and young people are leaving in droves. Of course, nearly ubiquitous surveillance would be much more likely. Probably not all of our worst nightmares, but more than enough. I personally believe (I even wrote a terrible paper about it that will never see the light of day) that the biggest and most pervasive threat to freedom in regards to privacy will lie in the intersection of (not strong but good enough) AI, social media, and the internet of things. Essentially, we're coming to a point at which our devices will be designed to interact with us emotionally, as well as socially, and as a result people will be trained to form deep emotional relationships with products as well as people. Imagine having a deep intellectual conversation with someone online, only that someone is a refrigerator, or a car. Imagine most of the friends you've grown up with are products, because most of your interaction is online. Maybe it happens, maybe it doesn't, but almost certainly it won't happen the way we currently predict. The future right after the moon landings isn't the one anyone would have predicted. We were supposed to be drinking Coca-Colas on Mars by now. Although if it did happen, then i'm still not entirely certain the 'humane-but-totalistic' model necessarily works. In theory, yes, but in practice, if everyone knew everything about everyone else, this wouldn't necessarily balance power between the weak and the strong (and imbalance which exists in the real work, but not Star Trek) but would enable the strong to more easily dominate the weak. Because such systems can't be perfect, there must always be ways to exploit information asymmetry. Governments, corporations and criminals will always be more able to rig the system than will the common person. I like Star Trek, but because it presents a Utopian ideal, i'm skeptical of using it as a springboard for describing actual potential future societies, because humans just don't work that way. Every other species on in the franchise was more human than the humans (purposely, because they were there to be mirrors on the 'unevolved' aspects of human nature.)
- carapace 12y agoVery good points, and I agree wholeheartedly that the confluence of "good enough" AI, mass data on social interactions, and ubiquitous networked sensors+cpus means that we are rapidly entering a sort of intense feedback system with ourselves that calls into question the very meaning of being human, and that it could be a threat to freedom. ;-) It is definitely neither cynicism nor wish-fulfillment that makes me think the future system (assuming we don't simply destroy ourselves or degenerate into some N. Korean nightmare) has to be totalistic, and that it will be humane. I think it has to be "total" in the sense that in order to apply and enforce whatever policy we have, including policy around who gets to access and use surveillance data, somebody somewhere has to be looking at all the data and searching for violations. Flipping it over, I don't see how any government can say to its people "Hey, we know for sure that no one is spying on you. (Except us.)" without spying on everyone to make sure. So I don't see how we can avoid the technology forcing the "political, economic or societal forces" to adapt, rather than the other way around. At best most people would be content with some privacy-protecting measures that other people would simply find ways to circumvent, and since the circumventors have greater ability to act without the contented people even knowing about it, how would you stop them? Effectively the U.S. agencies and their allies are already merging into one large "trustworthy" (for some measure of trust, for some subset of humans) information processing system. Now, if we accept that somebody is going to have the panopticon the immediate concern becomes the nature of our rulers. I think the future cyber-totalitarian regime will be humane, but only because I have hope that humans are intrinsically good. I have no hope that we can roll back or even curb the capabilities of our technology but I feel confident that we can enshrine and effect our highest values within the system we are so vigorously constructing.