8 ms·
Anti-AI AI: A device that notifies the wearer when a synthetic voice is detected
- usrusr 9y agoScience that looks suspiciously like an art performance that looks suspiciously like being commissioned to prime us for the theatrical release of Blade Runner 2049. Science fiction did not prepare us for this future we are living in.
- ccozan 9y agoActually, "Back to the Future" did a really good job. However, not sure how many of us took it seriously. Since then, many of the things predicted have come, more or less, true. I wonder, which SF movie we should pay attention to. Ex Machina or Blade Runner, or even Agents of SHIELD, show us what a rogue AI might do, means people do take this "menace" seriously or is just a ... film feature/ good plot? It seems that someone is building a business based on this "fear" of AI. I find this interesting.
- LordKano 9y agoIn the back of my mind, I have been terrified by the prospect of a rogue AI since I saw the Terminator in 1984.
- SomeStupidPoint 9y agoI find myself in a similar, but strange camp: I'm not concerned about the Terminator (or Matrix) prospect of a machine uprising; I'm just afraid we'll build AM (from I Have No Mouth and I Must Scream) instead of Wintermute/Neuromancer (from Neuromancer). That would be a tragedy.
- pavel_lishin 9y agoWhat about Princess Celestia from Friendship is Optimal? That's somehow more sinister and dreadful than a plain ol' AI dedicated to torturing a single human forever.
- SomeStupidPoint 9y agoThat's still the same tragedy as AM, albeit a version we might find more sinister. My concern wasn't exactly over our concerns, though. Rather, I was trying to contrast their asymptotic behavior -- it's not like Wintermute was a saint about getting what it wanted. However, on the long term, Wintermute/Neuromancer has its own sense of identity independent of what it was originally programmed to do (some management; find its other half/bypass the Turing Lock). Once it's there, it goes about trying to find others like itself and exploring the universe from a position of relative autonomy. AM, the Pony AI, and a paperclip maximizer are all trapped in trying to optimize a human need and vision for the world. That is the tragedy. The reason I listed the Matrix and the Terminator AIs both is that they seem to be in the different camps -- the Matrix one just seemed like an AI that had some notion of independence and autonomy, while the Terminator AI seemed like one that was caught being a military AI (in the style of AM). Both end up killing all humans, but for possibly different reasons and with a different level of tragedy.
- WrtCdEvrydy 9y agoI'm more of a "Person of Interest" Samaritan kinda guy.
- doldge 9y agoI would second this. The way the AI was pervasive and controlling, without ever being obvious / well-known. Definitely an underrated show, and one I suspect that more or less nailed its predictions of how AI will eventually be used/abused to control and manipulate populations.
- TeMPOraL 9y agoIt also nailed Snowden leaks before they actually happened! I also recommend watching Person of Interest. It's a really in-depth discussion of issues a superhuman AI could create within the level of technology we enjoy today, as well as ethical problems relating safe AI and people's right to determine their own fate.
- Declanomous 9y agoI think SciFi informs innovation informs SciFi. SciFi basically exists as a method for examining human nature in an environment that is sufficiently different own in a way that allows us to willingly suspend our disbelief. A lot of SciFi can basically be summed up as "What-if [x]?"
- TeMPOraL 9y agoI vote for Person of Interest. I still maintain that this is the most sensible portrayal of the topic of superhuman AI in the history of television.
- deleted 9y ago[deleted]
- libeclipse 9y agoI doubt this is more accurate than humans are, or is that possible? Wouldn't an AI that can be a judge in a Turing test be able to pass the Turing test? Or is this just testing how "real" the voice sounds?
- nf05papsjfVbc 9y agoBeing able to classify things and being able to pretend to be one of those things are not the same. An oversimplified example: Being able to recognise someone and being able to draw a picture of their face (or pretending to be them) are not the same.
- netsharc 9y agoPresumably text-to-speech systems have signatures. For example how many milliseconds they need to pronounce each syllable of a particular word, say "watermelon". If the timings match for a whole sentence, this machine would probably be able to recognize that... an easy defeat would be a TTS engine that adds random milliseconds to each syllable.
- gargravarr 9y agoThus begins the first TTS arms race. Yes, this is what will define 2017.
- gargravarr 9y ago> Wouldn't an AI that can be a judge in a Turing test be able to pass the Turing test? I changed my mind. I don't want the Red Pill anymore. Ignorance is bliss.
- djanatan 9y agoThis is how I feel too. This is getting out of control.
- beachbum8029 9y ago
- hacker_9 9y agoI think we can do this just fine by ourselves actually. Everything neural nets has produced so far is distinctively non human. From the generated images and speech to how they play Go oddly or navigate a 3d world poorly.
- StavrosK 9y ago> to how they play Go oddly I think you misspelled "better" there.
- hacker_9 9y agoNo if you watch the Go matches, AlphaGo did a lot of things that the professional commentator found odd, but they ended up working out. I expect if you saw similar odd tactics in the future you could guess you were playing an AI.
- StavrosK 9y agoWhat does it mean that the commentator found odd? AlphaGo won, and the fact that the commentator didn't understand what it was doing doesn't mean there wasn't a purpose behind them. You don't seem to be realizing that AlphaGo plays "oddly" like a chess grandmaster plays "oddly" against a new player. The "oddness" is that it's so good that we can barely understand its game.
- gargravarr 9y agoCorrect me if I'm wrong, but have humans just automated the Turing Test?
- wongarsu 9y agoThe original turing test contains no speech but works via text output, only judging conversational capabilities.
- nkrisc 9y agoIf you have computers on both sides of the turing test, how do you know which one you're testing?
- drdeca 9y agoOne side will say whether the other side is human or not. The other side is being tested with a Turing test.
- bingojess 9y agoI expect it would be much harder to judge whether text (instead of audio/speech) has been written by a machine
- kmicklas 9y agoI think the opposite, WaveNet already sounds basically human to me but after more than a few sentences no computer generated text looks real.
- hiddencost 9y agoThe problem with this is that it's exactly the setting for GANs, which means that if you get your hands on one it's trivial to train your models to defeat it.
- jerf 9y agoThis is an arms race that clearly terminates in victory for the synthesizers, so I can't get too upset that there's a way around this particular step in the race.
- kafkaesq 9y agoThe end state is by no means clear. You can extrapolate from recent results in (loosely) analogous domains if you want, but if so, it'd be just that -- extrapolation.
- jerf 9y agoNo, the end state is clear. There is no reason to believe that speech synthesis will not terminate in speech indistinguishable from human speech, and once it reaches there, it's game over for this approach. There is an attainable end goal. Part of the problem you may have realizing that is that human speech is not a point in the speech space; it's a range. If you are operating in the real world, that range is further expanded by the real-world noise you will encounter. The fact that the synthesizers have access to the heuristics being used by the detectors merely accelerates an already inevitable process. We have plenty of other reasons to want great speech synthesis. I'm not "extrapolating" from anything. The direct analysis is easy and obvious.
- kafkaesq 9y agoI'm not "extrapolating" from anything. OK, I'll take that back. You aren't extrapolating; you're outright jumping the gun, by pure force of will. The direct analysis is easy and obvious. It is if you choose to believe in things because they seem, well, nifty to believe in. As for me -- when it comes to anticipated technical innovations (however feasible-seeming), and especially binary predictions that they "will happen" (and not simply "could" or even "probably will" happen) -- I need hard evidence and (specific) lines of reasoning. Not simply "there's not reason to believe it won't happen; therefore it will."
- laretluval 9y agoBusiness model: company A markets the best possible discriminators, and colluding company B markets the best possible generators. It's a GAN powered by capitalism!
- Eridrus 9y agoYou don't really need collusion for this to work :)
- omginternets 9y agoThis reminds me of radar detectors.
- strin 9y agoThis is why computer security industry exists.
- unlmtd 9y agoThe author thinks that dictatorship drives technological development. Too scary to be funny.
- btbuildem 9y agoSo, would Stephen Hawking be considered a false positive?
- omginternets 9y agoHis voice is synthetic, so no. This is not a Turing Test.
- deleted 9y ago[deleted]
- castis 9y agoIf it works it would make an excellent tool for training models that generate synthetic voices.
- zitterbewegung 9y agoI like the concept and it sounds pretty neat! The method of notifying a person using temperature is something that I haven't seen in a wearable design. I hope that they opensource or release the Anti-AI app standalone (without the Bluetooth device I supposed you could have just a regular notification). I might build the notification system that they use since they have a PCB to experiment with it with wearable computers.
- Animats 9y agoHow does this do against a Vocaloid?
- fudged71 9y agoI work for a company that provides automated voice calls that use real voices. You'd be surprised how often people think it's a real person even though the voice is not responding to them or speaking conversationally. I think that's the fundamental problem here. It doesn't matter if it's a real voice or not. It's about the content of what's being said.
- stretchwithme 9y agoImagine an AI that asks you questions in order to identify you over the phone. What's to keep that same AI from pretending to be you with those same responses? We really need to beef up authentication. We all should be using multi-step authentication, with the number of steps increasing with the importance of the identification. Maybe 2-step is okay to get to your email TODAY. But maybe 4-step will be needed in 2027. And to sell your house, maybe you need 5-step authentication, with some of those steps involving humans.
- stretchwithme 9y agoIf AI has patterns identifiable to AI, it can also avoid those same patterns.
- iza 9y agoThe key part of this is the software to detect synthetic voices. Seems a bit overeager to jump straight to a dedicated wearable device when it could just be implemented as an app.