11 ms·
What I think is interesting is that many of us nerds have probably innocuously fantasized about having a Star Trek-like AI assistant with us, but now that they'
by TulliusCicero 10y ago
What I think is interesting is that many of us nerds have probably innocuously fantasized about having a Star Trek-like AI assistant with us, but now that they're taking the first steps towards that, we're starting to realize that in order for it to do everything for us, it has to know everything about us, too.
- johngalt 10y agoThe only thing we got wrong. We expected the machines that knew everything about us to be ours. Not someone elses.
- shostack 10y agoBingo. The movie Her was awesome. But rewatch it. In every scene the AI does something cool, think what permissions it would need and what data it would have to have access to about you to accomplish the task. It gets scary pretty quickly.
- option_greek 10y agoWe always assumed they wouldn't spill their beans to third parties. I guess that was assuming too much.
- bbctol 10y agoI think we just envisioned a highly anthropomorphized AI: essentially, a very smart and entirely obedient person to serve as the perfect aide. The Star Trek dream emerged before computing technology was very far advanced, and well before the idea of constantly mobile wireless communication. We thought our AIs would be small and physical, easy for a single person to entirely own and unable to remember more details than a human; instead we got unfamiliar algorithms run on machines far away.
- dragonwriter 10y ago> The Star Trek dream emerged before computing technology was very far advanced, and well before the idea of constantly mobile wireless communication. We thought our AIs would be small and physical, easy for a single person to entirely own and unable to remember more details than a human; instead we got unfamiliar algorithms run on machines far away. Which is kind of funny, because even if it might be accessed by personal mobile devices, the Star Trek "library computer" AI was never "small and physical, easy for a single person to entirely own and unable to remember more details than a human", it was an aspect of a large server (or networked cluster, the actual architecture is somewhat vague) that was part of a capital ship or base, had access in the server/cluster to a library of very nearly all generally available knowledge and extensive personal information about both its users and about people with little direct connection (and could reach out across a galactic network to access additional remote information sources to handle requests). "Unfamiliar algorithms run on machines far away" is much more like the source of the "Star Trek dream" than "small and physical, easy for a single person to entirely own and unable to remember more details than a human".
- bbctol 10y agoTrue! I suppose I was thinking of earlier space-age fantasy more than TNG. It was rather odd how easily people could look up details on crewmembers aboard the Enterprise, but I suppose the situation's different on an organized ship.
- dragonwriter 10y ago> It was rather odd how easily people could look up details on crewmembers aboard the Enterprise, but I suppose the situation's different on an organized ship. Not just crewmembers: TNG showed some of the broader implications (both useful and creepy) of the convenience-oriented panopticon, e.g., when Geordi used the Enterprise library computer to construct a simulation from data (including personality profiles) of Dr. Leah Brahms, who later meets him (and encounters the simulation.) (S306 "Booby Trap", S416 "Galaxy's Child")
- VLM 10y agoThat was a substantial plot hole where she had no idea someone was simulating her. I suspect a huge part of the panopticon culture would be / is being informed that you're being peeped at. 99% of the time someone asking "Computer locate commander Riker" involved commander Riker knowing all about who's looking for him and why and having a substantial conversation with the requester. I don't recall any plot along the lines of Deanna getting jealous and spamming the computer all night asking where Riker is and he better not be in that cute ensign's bedroom... Because it seems logical the computer would inform him each time and he would eventually tire of the interruption and nature would take its course, WRT his relationship with Deanna. A better analogy would be technically I could walk up to the company president's office and stalk him, but culturally that is so not going to fly and I would have a lot of explaining to do. Merely using the computer instead of walking there in flesh isn't a major cultural shift. However, every single "holodeck creeper" plot line involved the simulated attractive real world woman not knowing she's being simulated until the plot reached maximum spaghetti spilling cringe, which is one of the few Trek panopticon situations where people being spied on did NOT know they were being spied on, which seems very un-trek, although it made for some entertaining stories. An alternative interpretation is I believe over the course of the series every attractive woman on the ship was simulated on the holodeck at least once by at least one lonely guy, and its possible that culturally they just got used to it, although I find that unlikely. People do get conditioned to become used to the weirdest things, so its not out of the realm of possibility. Possibly a culture of what happens in vegas stays in vegas develops and its just the sexism of the TV show that they never showed the women turning the tables on their fellow male crewmen on the holodeck.
- gvurrdon 10y agoIsn't it the case that Apple's attempts at similar AI assistance store much of the data on the user's iPhone?
- mattmanser 10y agoIt really is the big problem at the moment with the cutting edge of AI. ML relies on large data-sets and if anyone tried to release a personal device it simply wouldn't even work, let alone compete with the mass surveillance google/ms/amazon are bringing to bear. Unless the state-of-the-art in AI suddenly morphs, we seem to be stuck between giving up our privacy or having vaguely intelligent AI. I personally fall heavily on the privacy side of stuff, but I can see the intellectual and commercial appeal of pretending it doesn't matter in order to get there.
- arca_vorago 10y agoI thing the fallacy here is that a single person can't create a large enough dataset, while I content they can. Combined with tools like pocketsphinx I think its very doable to have a privacy concious AI system.
- darkpicnic 10y agoThis is simply a matter of AI not being advanced enough at the moment. Take how a human learns: it acquires experiences and information over a long childhood, and from this "data set" is able to do millisecond predictions of future events based off completely new data. What needs to happen is a company needs to come along and create AI that is trained off of generalized information... some kind of socially accepted public data set... then the trained core is sold as a seed to individuals who then feed it their personal data. It'll be the equivalent of buying an AI "teenager" and slowly training them to be an "adult".
- internaut 10y agoThat's the thing. As sensors become richer and the data becomes more valuable to the ML, consumers are becoming more aware of their privacy. That means to get to a 'good seam' in the future instead of trawling through trash, you're going to have to convince millions of people their interests won't be affected. That means in time there is an opportunity for a Google-killer with a different business model not based on using the raw data OR using by the use of intelligent agents. Google goes down because its stakeholders are contingent on getting to the raw data.
- JonathonW 10y agoGoogle doesn't "spill their beans" to third parties-- what Google actually sells is the opportunity for third parties to be included in the advertisements Google is targeting to their users. Google has a strong incentive to not allow their aggregated user data to leave Google-- the behavioral data Google collects is the reason why Google is valuable; if they start shipping that data off to third parties, suddenly the third parties don't need Google anymore. (Same with Facebook-- they're not "selling" your data; they're selling the opportunity to target you based on your data, but the data itself is too valuable to Facebook to sell.)
- gue5t 10y agoGoogle (or Facebook) is the third party. The first two are you and your computer.
- ProAm 10y ago> Google doesn't "spill their beans" to third parties Except the government who gets unfettered access. Not into conspiracy theories but Im definitely not a fan of this (and it goes for all social media and technology companies)
- Oletros 10y ago> Except the government who gets unfettered access. Does you have a source for that?
- mc32 10y agoI think some people would be okay with that if: 1. That information were secret (you and service/device/implant) but not a whole company and its third party interests. 2. It wasn't making money for a third party after the initial purchase price for the device, service, etc.
- pat2man 10y agoSo Siri.
- falcolas 10y agoSiri recordings are uploaded to the cloud for transcription, and reviewed by third parties to improve transcription and the AI. It also can arbitrarily decide to query search engines to answer questions. So, better, but nowhere near "on the device only".
- throwanem 10y ago> reviewed by third parties to improve transcription and the AI Cite?
- falcolas 10y agoSiri commands stored by Apple: https://www.wired.com/2013/04/siri-two-years/ https://www.wired.com/2013/04/siri-two-years/ First party report of reviewing recordings: https://www.reddit.com/r/technology/comments/2wzmmr/everything_youve_ever_said_to_siricortana_has/ https://www.reddit.com/r/technology/comments/2wzmmr/everythi... News article with more investigation and citings: http://sanfrancisco.cbslocal.com/2015/03/12/strangers-apple-siri-data-third-party-privacy/ http://sanfrancisco.cbslocal.com/2015/03/12/strangers-apple-... Siri Privacy Policy excerpts: When you use Siri the things you say will be recorded and sent to Apple to process your requests. Your device will also send Apple other information, such as your name and nickname; the names, nicknames, and relationships (e.g., “my dad”) found in your contacts, song names in your collection, the names of your photo albums, and the names of apps installed on your device (collectively, your “User Data”) [...] By using Siri, you agree and consent to Apple’s and its subsidiaries’ and agents’ transmission, collection, maintenance, processing, and use of this information, including your voice input and User Data
- someone7x 10y agoI think there's an additional nuance, that of Google knowing everything about us. If I hacked together my own home automation AI system it would need to know everything about me too and that worries me far less.
- unprepare 10y agoonly if you hacked together your own search, maps, calendar, etc. as well. Maybe someday that will be a realistic endeavor, but it would take a lot of effort to set up and maintain your own personal versions of all of google's services, and integrate them
- nine_k 10y agoHosting your own mail, calendar, cloud storage, and even a mapping application is quite doable right now. There are open-source projects for that, and you can have your own physically secured machine in a co-location facility for a reasonably small sum. It's just not easy to do, both in setup and maintenance effort. Most people would not care about their privacy nearly enough to justify that.
- ocdtrekkie 10y agoMy recommendation for people to look into here is Sandstorm.io. It runs either on-site or in the cloud, and it already can replace a lot of what one uses cloud services for. In time, hopefully open source projects will develop "intelligent" apps that can then tap into that data and do more with it, still within the confines of your secure, private storage.
- Malarkey73 10y agoI think it's possible to create a hybrid whereby your personal AI - has access to those external systems to check public (maps, search) and cloud data (calendar, mail). But it stores the private data about your location, your searches, your purchases. this could even be an encrypted private fire-walled bit of cloud rather than a robot in your house. The point being your AI is serving you. And you can delete/edit this private data (or even the whole AI) if you wish.
- corobo 10y agoUntil it started happening I always assumed it'd be powered by a central computer I had in a clean area of the attic or something. Not some DC somewhere.
- crisnoble 10y agoI think most fantasies are okay with the anthropomorphic AI assistant knowing everything about us, but don't involve the AI transmitting all of it's data back to "the cloud" where advertisers can mine this data or the NSA could listen in with a secret gag ordered wiretap. Probably wishful thinking, but maybe one day a privacy first company will dip their toes into this arena.
- ska 10y ago"Knowing" in some sense everything about us is not the same as owning that information or trading in it. There are many other possible approaches to applying ML to our personal needs and data, so it is worth being careful about not conflating issues with a particular implementation and issues with the area as a whole.
- yid 10y agoI think people also forget that the Star Trek AI was in a semi-militarized scenario where efficiency and information greatly outweighed individual privacy needs.
- csydas 10y agoWell the missing part is the dedication to ideals and to the greater good of all life that was supposed to be core to the federation. I realize Star Trek is fantasy, but the reason people are more at ease with the omnipresence of technology in Star Trek is because you see people living by these humanitarian and noble ideals. People fight and die to defend thems. The right to self and privacy and protection is held very high in the st universe, even if challenged. When's the last time Google risked itself or business or any tech ceo risked their livelihood for the sake of the greater good? The problem isn't necessarily the knowing everything part, it's who does what with it that's the problem. I can't really think of any company or person with influence in tech that'd be willing to dive onto that bombshell to protect us all.
- pjlegato 10y ago> When's the last time Google risked itself or business or any tech ceo risked their livelihood for the sake of the greater good? February of 2001. https://en.wikipedia.org/wiki/Joseph_Nacchio https://en.wikipedia.org/wiki/Joseph_Nacchio The former CEO of Qwest, a massive telco, spent years in prison for insider trading. He says this is because he resisted the NSA's demands to tap Qwest's network and hand over customer data.
- johndubchak 10y agoThe fundamental issue comes down to one of trust and the real question is, do we trust Google to do the right ethical and moral things with our data that they are collecting en masse?
- agumonkey 10y agoDaydream is way better.
- darklajid 10y agoHas Star Trek even a currency? It always feels like a socialist/communist thing to me. You cannot compare the world's biggest seller of advertisement space with the ST universe. The motivation's aren't aligned: Google/Alphabet want to make sales based on my information. I agree that I found these oh so clever AI fantasies interesting in my youth, still do to a degree. But I always pictured the data being held inaccessible to humans in general ("Where's my wife right now?") and not in the hands of a golden few with no oversight.
- eternalban 10y agoStar Trek's world seems to be a 'utopia' of scientific-military governance. Most of the key players have a military rank, wear color coded uniforms, and appear to be under 24/7 surveillance (which is OK since this is a very nice and progressive scientific-military goverment and you know War On <scary-alien-specie> and all that. :)
- r00fus 10y agoMost of Star Trek is aboard starships and stations - I wouldn't imagine that leaves much for privacy. Plus, most folks think ST is where hippies took over. Center of Federation is in San Francisco...
- darklajid 10y agoGiven the "War On $species" thing, "War On Romulan Ale" might work as well? Remember kids: Don't intoxicate yourself with substances we do not condone. :)
- CaptSpify 10y agoWas the society under constant surveillance? or just the part of society the show highlighted?
- pmoriarty 10y agoI don't remember seeing any Star Trek episodes that showed people under surveillance in their private quarters or in bathrooms. The public areas which were under surveillance on Star Trek tended to be only on military ships and star bases. I don't remember seeing much surveillance in public areas on planets. There certainly wasn't the sense that everyone was under surveillance on every street and in every shop, unlike most people in major metropolitan areas on Earth today. Nor was there anything on Star Trek like the ever-present spy satellites that can see in great detail anywhere on Earth today. For the public areas which could be observed through cameras on Star Trek, the surveillance seemed mild compared to today because of Star Trek's lack of massive computers and artificial intelligence analysing what is seen for anomalies, using facial recognition, constantly recording everything and having those recordings instantly available for playback, sophisticated search, and computer analysis. The reading and viewing habits of Star Trek denizens weren't recorded and analysed, unlike those of many people on Earth. Their positions weren't tracked wherever they went, unlike those of many people on Earth. The so-called "24/7 surveillance" of Star Trek was very limited and even quaint compared to what we live under on Earth today.
- pimlottc 10y agoNobody was thinking about "the cloud" back in those days. Back then, your data, you programs all lived and ran on your own computer in your home. Most people didn't go online, and if you did, it was mostly to read and download data to use locally on your own computer. Connections were intermittent and slow. The idea that your own data would be stored online was almost unimaginable; even using network-depending applications like usenet or email involved downloading everything first before using it. Online applications were hardly even dreamed of. Our expectations of how "Star Trek AI" would actually be implemented were completely different than how highly connected cloud-based services like Google Assistant work today. Anyway, the point being, if the assistant lived entirely in your own computer, it would entirely different. Most people are not concerned about what their "computer" knows about them, they're concerned about what companies and their employees do.
- joe563323 10y agoNailed it.
- buckbova 10y ago> The idea that your own data would be stored online was almost unimaginable Except that's what I did for many years using a computer only as a terminal for an AIX mainframe. My mail was there, I browsed what was the web, used gopher, wrote programs, all stored there.
- sangnoir 10y ago> Our expectations of how "Star Trek AI" would actually be implemented were completely different than how highly connected cloud-based services like Google Assistant work today. The trope-namer (Star Trek AI) was a ship-wide AI - when considering the ship sizes, it definitely is closer to the "cloud" model and not limited to a private instances on officers' bunker/bridge terminals/tricorders. Perhaps a hardcore Trekkie could answer this question: is there any canon that defines the AIs scope? Is restricted to just one ship, or could it possible be a Federation-wide presence with a presence/instances on ships?
- unprepare 10y ago
- erdevs 10y agoThe big difference is the Star Trek computer wasn't using its data about Kirk to provide him "enhanced advertising experiences", there wasn't a big corporation controlling the computer and no government was accessing the computer's information. A truly user-aligned AI assistant would be great. Ideally in the future these things will not be tied to indirect business models, but rather will be something you buy and all data/services will be under your control.
- joe563323 10y agoYes. Also running the AI on local computer made sense because there is no incentive to run it on cloud. Since nothing is gained. Star Trek is set on post scarcity economic society. We will get there once basic income becomes the norm in all countries.
- Artistry121 10y agoCapitan Kirk was a government employee. It's implied the government/StarFleet could access the ships logs. In the Star Trek world they had no advertising because they were a communist society. Everyone dressed the same or slightly differently based on rank. It's interesting how the new movies play over that. In Star Trek you couldn't choose your AI. In our world you can. At the start of their development most of them are targeted at selling you stuff - but the industry is young and who knows where it will go.
- snerbles 10y agoIt would be more accurate to say that most of Star Trek depicts life in Starfleet, a pseudo-military institution (Roddenberry insisted that it isn't, while war isn't Starfleet's main purpose it shares enough traits with modern armed services to suffice for this discussion). There is always a lesser expectation of privacy for military personnel, even in the US armed services. While there are elements of communism depicted in the Federation as a whole, those are facets of a global post-scarcity society that has somehow evolved beyond the less "progressive" bits of human behavior. I'd argue that the biggest fantasy of Star Trek isn't warp drive, but the notion that humans are somehow less violent than Klingons.
- tempodox 10y agoYep. I see us somewhat conflicted about this. We would love the (imagined) benefits, but we have no idea yet how to avoid the dangers.
- AndrewKemendo 10y agoNot to sound glib, but the idea of persistent data acquisition and aggregation has been pretty well known to be in the path for anyone seriously researching AGI or other human level AI systems. How could it be otherwise?
- Someone 10y agoYou could have realized that from watching Star Trek, as the computer in the Enterprise can always tell the captain where every crew member is, whether there are strangers on board, etc.
- nothis 10y agoIt doesn't though, does it? The only reason this is a problem is that Google's business is still advertising and they act like our problems can be solved by tools made to sell more ads. The moment I could buy an AI service for like $10 a month (it had to be good), I'd trust them with using my data responsibly. The Star Trek fantasy is, "Computer, what were the principal historical events on the planet Earth in the year 1987?", and it could totally answer that without sending your entire fucking message history to google for deep AI inspection.
- dragonwriter 10y ago> The Star Trek fantasy is, "Computer, what were the principal historical events on the planet Earth in the year 1987?", and it could totally answer that without sending your entire fucking message history to google for deep AI inspection. That's part of the Star Trek fantasy. But so is, "Computer, locate Commander Riker" and "Computer, use personal logs and personality profiles from compiled databases to create a personality simulation of Dr. Leah Brahms."
- r00fus 10y ago> in order for it to do everything for us, it has to know everything about us, too But does it? Does it have to know your birthday? (leave alone the fact that bdays are somehow part of a superkey for your identity). Why should it know my residence, my spouse, or my CC# (with Apple's TouchID maybe it won't need to)? Google's concept of AI is too creepy for me. It can be useful without being creepy. They're not even trying to make it less creepy. Overlay on this the subtext that NSA and other tla's are monitoring all this (leave alone other countries). While I may trust Google, I don't trust them to not be forced to collude with the government.
- Esau 10y agoI have to admit this is true -- I used to dream of a Star Trek like computer where you can just speak to it but I never imagined that such as system would be strife with privacy and security issues.