25 ms·
AI Clones Your Voice After Listening for 5 Seconds (2018)
- lukeplato 7y agoTwo minute papers video: https://www.youtube.com/watch?v=0sR1rU3gLzQ https://www.youtube.com/watch?v=0sR1rU3gLzQ
- nkkollaw 7y agoThis is pretty scary.
- ihm 7y agoReading this headline I begin to understand certain people’s worry about having their soul stolen upon being photographed.
- jacquesm 7y agoI had that exact same thought the other day in respect to biometric data from photographs.
- jmann99999 7y agoYou mean the abo-diginals? :-)
- nwsm 7y agoImages of us can be sourced from any number of places: social media, government surveillance, private surveillance. Video less so but from the same sources. Audio from phone companies, VoIP services, surveillance, etc. Health data easily from a number of private companies if you use new-age "health" services, or less easily (illegally) from health records. Maybe we can find solace in the fact that is or will soon be infeasible to avoid, so we needn't try to avoid it.
- ben_w 7y ago“Don’t worry, just about anyone can steal your soul and there’s nothing you can practically do to stop it” That doesn’t seem like a message of solace to me.
- aidenn0 7y agoI am okay with the events that are unfolding currently. http://gunshowcomic.com/648 http://gunshowcomic.com/648
- baroffoos 7y agoThe message is "Just about anyone could replicate your voice, its value in authentication is about as trustworthy as writing your name at the bottom of a letter"
- deleted 7y ago[deleted]
- sundarurfriend 7y ago>> Maybe we can find solace in the fact that is or will soon be infeasible to avoid, so we needn't try to avoid it. It's the meager solace of the absolution of personal responsibility - there's no way to avoid it, so at least no one can say "why did you allow that to happen to you".
- nsomaru 7y ago“When remedies are over griefs are ended”
- Dramatize 7y agoI'm looking forward to moving past just talking about the AI and concentrate on the new products the tech enables. I guess it's similar to how most photos are a means to an end now, rather than the final product. ie satellite imaging or Instagram.
- code_code 7y agoEven decades ago I gave such reported concern with photographs more credence than the typical western account of it. I also wondered if the translation was precise enough -- could it (in some cases) have reflected a concern with "essence" more generally? Even without reference to a soul the concern can be a bit immaterial.
- nsxwolf 7y agoA staple of science fiction comes to life.
- teraflop 7y agoAnd conversely, Star Trek's frequent use of voiceprint authentication looks sillier by the day.
- siffland 7y agoCode 1,1A Code 1,1A,2B Code 1B,2B,3 Zero-Zero-Zero Destruct Zero What that is secure.......
- WrtCdEvrydy 7y agoNow imagine the Borg with their advanced computers not being able to cause all Federation star ships to self destruct (BSG style).
- toomuchtodo 7y agoFun fact: Several financial institutions (Vanguard, Schwab) allow your voiceprint to be an authentication mechanism.
- floatrock 7y agoThere was a story a few months back about some British subdivision VP wired a million dollars to eastern europe because the CEO called him up and told him to do it or something like that. It was the CEO's voice, but it wasn't the CEO.
- A_Parr 7y agoIt rarely even worked in Star Trek.
- visarga 7y agoIt's even sillier when robots in almost all sci-fi movies have 'robotic voice' and human level intelligence. It's actually much easier to have human voice and 'robot intelligence'. They got it backwards. At least the computer voice in Star-trek and Data's voice were human.
- goodmachine 7y agoThe malign applications of this technology greatly outweigh the benign. Discuss.
- telesilla 7y agoOn a benign level, many VO artists will find themselves out of work now that we can have Don LaFontaine back. On more positive outlook, perhaps this, along with deepfakes, propels us faster towards an evidence-based society.
- rshi 7y agoOn a related note, I can definitely foresee a lot of voice actors having their voices cloned for uses they wouldn't really intend. Seems like a big legal grey area as many countries have personality rights.
- SamBam 7y agoCon: It's now easier than ever to fake someone saying something outrageous, and have that lie spread across the world long before the truth can get its boots on. Pro: Humphrey Bogart can direct you to your destination! I admit, it's a hard choice.
- deleted 7y ago[deleted]
- carapace 7y agoYes, I think there are almost no legitimate uses for the Farnsworth Device. https://theinfosphere.org/A_Device_That_Makes_Anyone_Sound_Like_Farnsworth https://theinfosphere.org/A_Device_That_Makes_Anyone_Sound_L... My personal hell: My mother has dementia and a land line telephone. Scammers call all the time. All day long. (Although the last few days have been pretty good, I assume somebody somewhere is doing their jobs. The scammers will adapt.) One thing they do is spoof their number to have the same area code and prefix as the one they're calling, so it's like "Oh, is this a neighbor?" or something, but of course it's not. It's an automated machine abusing the telephone network to try to steal money from a little old lady with dementia. Evil men with robots are attacking my mom. Another one called while I was writing this post! This is a goddamned sci-fi dystopia. And now the robo-thieving bastards can imitate my voice!? I'm going to have to get her one of those satellite-linked walkie-talkies or something. Thank God she doesn't use the internet.
- czbond 7y agoI have not been "wow-ed" by a technology in quite a while on HN. Wow.
- Lordarminius 7y agoAI can make decisions, create deep fakes, and now, clone voices. It may be that the next big business opportunity lies in creating 'anti-AI' technology just as it did with antiviruses in the 90's and 2000's
- andrewfromx 7y agoah yes, if u listen carefully to the samples, you can always tell subtle things that make it seem a little off. Maybe if you look at the binary data very carefully, it would be easy to show HUMAN_AUTHENTIC or CREATED_BY_MACHINE and sell this service. Someone have a recording of something you never said? For $99.99 get it checked at AreYouHumanDotCom!
- hans1729 7y agoGood luck with that. The best product you'll come up with is some sort of snake oil. The whole point of GANs is that you can't really "detect" the synthesized components anymore. Not that this would/will stop people from claiming otherwise in the spirit of profitablity :-)
- kordlessagain 7y agoGANs may produce imagery or audio which fools humans, but they are unlikely to consistently produce imagery or audio which fools humans over time.
- 7y ago
- hurrdurr2 7y agoAutocratic regimes can rejoice...they can extract public confessions so much easier now...
- blacksmith_tb 7y agoOnly ones that care about the appearance of propriety though, presumably most never had to try to produce convincing fakes when their word was already law?
- x220 7y ago>Only ones that care about the appearance of propriety though Such as the United States?
- exo762 7y agoUSA is a plutocracy. Source - this study: https://www.cambridge.org/core/journals/perspectives-on-politics/article/testing-theories-of-american-politics-elites-interest-groups-and-average-citizens/62327F513959D0A304D4893B382B992B https://www.cambridge.org/core/journals/perspectives-on-poli...
- x220 7y agoThanks for the link, I was looking for something to read about this topic.
- frandroid 7y agoThe synthesized voices sound similar but would probably not fool a good voice-print system.
- werds 7y agoAnybody else notice how that Scottish male reference voice sounds considerably more English in the synthesized versions.
- VBprogrammer 7y agoYeah, maybe it's just having a more sensitive ear to the Scottish accent but that to me was the furthest from the reference by far.
- luxpir 7y agoI heard that too; being a Brit (and working in languages) probably helps. It did pick it up occasionally though, which gives hope that increased sampling and training could fix the slight miss there. It was that and the Swedish-accented English ("Sentence in Different Voices" section, middle recording) made it struggle. No traces of the Scandi-lilt were left in the synth version. Final note would be the French speaker at the bottom of the page seems to be English first language, despite having very good spoken French. Not quite as pure a test of that last part as I'd have liked, despite the ability for the speaker to perhaps read the synthesized version in English back in English. That could be fun.
- seszett 7y agoI can't hear any hint of an English accent in the French-language recordings, they just sound like regular Québec French to me. However, I'm not convinced at all by these voice transfers across language. I can imagine the second Chinese one being the same speaker in both languages, but not the three others.
- luxpir 7y agoThat's no Quebecois I've ever heard. Sounds like a Brit who picked it up as a second language in the home or soon after. Even struggles to finish the sentence due to the effort of reading in the 2nd to last one. Struggles with an extremely common word, 'grand', as well as stumbling over a simple sentence. To be fair, he has heard enough French (i.e. lived and studied there most likely) to get the intonations mostly right but there are a few other giveaways too... it's just not natural or native from where I'm sitting.
- jonplackett 7y agoDo papers like this have code to play with anywhere?
- lukeplato 7y agofrom two minute papers video description: > An unofficial implementation of this paper is available here. Note that this was not made by the authors of the original paper and may contain deviations from the described technique - please judge its results accordingly! https://github.com/CorentinJ/Real-Time-Voice-Cloning https://github.com/CorentinJ/Real-Time-Voice-Cloning
- jonplackett 7y agoFunny, it gives them all a slight American accent!
- anoncow 7y agoMission Impossible is now Mission Possible.
- costcopizza 7y agoI was born in the wrong era. Christ.
- ttul 7y agoYou were born in 0 CE?
- Angostura 7y agoMy bank's (HSBC) telephone banking offers the option do away with a PIN and instead a 'my voice is my password'phrase system. I'm glad I never opted in.
- ropiwqefjnpoa 7y agoOh god, Sneakers
- Angostura 7y agoJust to be clear - I'm Robert Redford
- mmazing 7y agopassPORT Also, that whole scenario would have been far less cool if they just recorded the dude for 5 seconds doing anything and pulled a whole CSI-style "put his voice into the visual basic GUI neural network and it works, bro!" I love Sneakers.
- bidluo 7y agoThe Tax Office in Australia does the same thing and push it every time I call, I imagine it branches out to the other gov bodies too. It's fun listening to the whole spiel about 'Like a fingerprint your voice is unique to you'.
- fasturdotcom 7y agounchecked, the progress of this technology and the staleness of banking security might cause entire institutions to fail
- shostack 7y agoI recently called Chase and got some message like "your voice may be recorded for verification purposes" or something to that extent. Creeped me out and I don't recall ever opting into that specifically, so I'm guessing it is an opt out buried in some agreement.
- tenebrisalietum 7y agoOh neat. I would totally use this to make ASMR audio in a voice different than my own without having to ask someone else to read a script.
- jacquesm 7y agoOne more scene from Terminator that we can now do for real.
- martin1b 7y agoWhat's wrong with Wolfy?
- andrefmoniz 7y agoIt means we can talk to anyone forever
- seph-reed 7y agoIt means you can make someone talk, non-stop, for an indefinite amount of time. Now I want to make an art piece that's just a valley girl droning on, and on, and on, and on about believable and obnoxious life experiences. The stores they go to, how they feel about certain colors, what "too spicy" is. It just never stops.
- visarga 7y agoHurry up, or it's going to be done soon by someone else. They just need to feed GPT-2 fine-tuned on selected texts to the speech engine. Bonus points for generating a face, too.
- judah 7y agoThis sounds like a brilliant idea, and I'm almost wanting to build it myself. If we can tack on a visual head and sync up the lips to the words, it'd be amazing and would likely go viral.
- seph-reed 7y agoShadyWillowCreek@gmail.com if you're actually interested in collaborating on this.
- AbbasHaiderAli 7y agoWow, impressive results! Already a few examples in the comments of what bad actors could do this tech. I wanted to share an example of something good. I lost my dad about 6 years ago after a Stage 4 cancer diagnosis and a 3 month rapid diagnosis. I have some, but not a lot of video content of him from over the years. My mom still misses him terribly so for her 60th birthday I tried to splice together an audio message and greeting from her saying what I thought he would have said. The work was rough and nowhere near what this Google project could produce. She listens to that poor facsimile every year for her birthday. It's therapeutic for her. With some limits for her mental health of course, I'm sure she would love to hear my dad again with this level of fidelity. And so would I.
- cayblood 7y agoBeautiful. Thanks for sharing. It's good to point out the positive potential uses as well as the negative.
- Aaronstotle 7y agoSorry for your loss, thank you for providing an optimistic example.
- mottiden 7y agoI'm deeply sorry for your loss. Thanks for sharing your story.
- dejj 7y agoSeems like, > This is just >> All can be returned, all can be taken away > with extra steps.
- ada1981 7y agoWhen I interviewed Ray Kurzweil we talked about the obvious-in-hindsight insight that his life’s work was essentially trying to build an AI to bring his father back to life.
- azinman2 7y ago
- retrovm 7y ago2018, FWIW.
- rshi 7y agoI wonder what the legal implications of this alongside similar developments like deepfakes are going to be in the next couple years. We're already having fraudsters impersonate CEOs using Deep learning-aided Voice generation[1] due to just how low the barrier of entry is now. There's already a public implementation of the paper out [2]! [1]: https://www.wsj.com/articles/fraudsters-use-ai-to-mimic-ceos-voice-in-unusual-cybercrime-case-11567157402 https://www.wsj.com/articles/fraudsters-use-ai-to-mimic-ceos... [2]: https://github.com/CorentinJ/Real-Time-Voice-Cloning https://github.com/CorentinJ/Real-Time-Voice-Cloning
- jermaustin1 7y agoThe latest episode of Blacklist had a dark plot based on deep-fakes.
- fasturdotcom 7y agodidn't know new season was out! thx!
- IshKebab 7y agoCorentinJ's implementation isn't quite as good as Google's - I think with some of Google's samples I couldn't tell that they weren't real, especially over the phone. But I could easily tell with CorentinJ's. That seems to be common with open implementations of Google's voice synthesis and speech recognition work. I guess they hold back some of the secret sauce, or can afford to train it more.
- qznc 7y agoCurrently watching UK: https://mobile.twitter.com/FutureAdvocacy/status/1194282481098350598 https://mobile.twitter.com/FutureAdvocacy/status/11942824810... Sorry for the Twitter link but Future Advocacys website seems to be down.
- jchook 7y agoLyrebird has had similar technology for a few years now. https://www.descript.com/lyrebird-ai https://www.descript.com/lyrebird-ai
- wenc 7y agoYes, I remember seeing this a while ago. Nice work by the MILA group in Montreal.
- 0xcafecafe 7y agoAn apt name for the technology considering the marvel of nature that the lyre bird is. https://www.youtube.com/watch?v=VjE0Kdfos4Y https://www.youtube.com/watch?v=VjE0Kdfos4Y
- Conlectus 7y agoWorth noting that Lyrebird is very rough -- at least last I tried -- and produced extremely robotic sounding (though recognizable) audio. This method has much clearer audio, but seems to lack generality / TTS capability.
- badrequest 7y agoHas anybody tried making an AI that generates 5 seconds of arbitrary speech to feed into this AI?
- kleer001 7y agoNo to create an Ai for that. Just like with any neural network random noise can be fed into the detector networks, fedback to its self then used to create novel maps. Like deepdream.
- snissn 7y agoI heard a rumor that robot calls were harnessing your voice prints. Not necessarily true currently but an interesting concern
- grawprog 7y agoSo....I'm going to paste the abstract here because the headline is incredibly misleading and should be changed. >Abstract: We describe a neural network-based system for text-to-speech (TTS) synthesis that is able to generate speech audio in the voice of many different speakers, including those unseen during training. Our system consists of three independently trained components: (1) a speaker encoder network, trained on a speaker verification task using an independent dataset of noisy speech from thousands of speakers without transcripts, to generate a fixed-dimensional embedding vector from seconds of reference speech from a target speaker; (2) a sequence-to-sequence synthesis network based on Tacotron 2, which generates a mel spectrogram from text, conditioned on the speaker embedding; (3) an auto-regressive WaveNet-based vocoder that converts the mel spectrogram into a sequence of time domain waveform samples. We demonstrate that the proposed model is able to transfer the knowledge of speaker variability learned by the discriminatively-trained speaker encoder to the new task, and is able to synthesize natural speech from speakers that were not seen during training. We quantify the importance of training the speaker encoder on a large and diverse speaker set in order to obtain the best generalization performance. Finally, we show that randomly sampled speaker embeddings can be used to synthesize speech in the voice of novel speakers dissimilar from those used in training, indicating that the model has learned a high quality speaker representation.
- aerovistae 7y agoDo you want to elaborate on how the title is misleading? From reading the abstract it seems accurate to me.
- corobo 7y ago"AI Clones Your Voice" implies there might be something on the linked page that involves an AI cloning my voice. Maybe a way to record a few phrases, maybe a text to speech that then uses my voice. Something like that. This does not do that - only provides pre-rendered samples, kinda disappointing. Impressive, but disappointing.
- lukeplato 7y agoI took the headline from this Two Minute Papers video: https://www.youtube.com/watch?v=0sR1rU3gLzQ https://www.youtube.com/watch?v=0sR1rU3gLzQ
- seph-reed 7y agoI think it's time we officially declare we're going the dystopia route, and really commit to it. The sooner we hit the great filter, the less suffering there will be.
- kleer001 7y agoSaw this on Minute papers last night and had a discussion with my partner about if we needed a secret password or not to tell if it were really one or the other on the phone. I figured that we had enough shared history that that wouldn't be a problem. Then we realized that there's no such thing as a simulated sense of humor yet and that that would be the best natural encryption to any communication.
- nighthawk454 7y agoHere's the link to the Two Minute Papers video if anyone else is curious: https://www.youtube.com/watch?v=0sR1rU3gLzQ https://www.youtube.com/watch?v=0sR1rU3gLzQ
- toxicFork 7y ago2023: ai identifies your sense of humour after hearing you breathe for 0.7 milliseconds
- kleer001 7y agoHa. There'd need to be so many more Ai breakthroughs to make that happen it'd be a little thing.
- thimkerbell 7y agoOk, what happens to society when this gets to be really good?
- tiborsaas 7y agoBetter memes, better apps, better scams
- fasturdotcom 7y agocomputers will have unique voices. someone will invent a conversational interface for programming the worlds demand for human programmers will go near 0 everyone will call themselves an engineer and live on basic income
- SubiculumCode 7y agoFor those who were unable speak e.g. S. Hawkings, it would have been feasible to have had the computer speaking system use a voice that had sounded like him prior to his condition. Amazing.
- SubiculumCode 7y agoIf acting was ever a good career choice, it isn't now. I am becoming convinced that actors will be replaced wholesale.
- visarga 7y agoNo, actors are still going to act. But their voices will be just an input feature to the speech engine.
- echelon 7y agoMeaning that this democratizes acting. Celebrity actors won't be required. I think this is a good thing for the field and gives a whole lot more people access to the opportunity they strive so hard to achieve.
- Verdex 7y agoI wonder if what we'll see is actors being deep faked etc over by other actors. So of the new actors we will say, "He plays a good Pitt, but his Clooney leaves something to be desired." Movie analysis will get arbitrarily complex. "Robertson playing Dwayne Johnson playing James Bond really wasn't the right choice for this film. Robertson playing Ferrell playing Bond OR Strong playing Johnson playing Bond would have both been better for the following reasons."
- datlife 7y agoWelcome to 2020. Crazy time to be alive!
- nmeofthestate 7y agoVCTK p240: duplicates the (a) north of England accent well. VCTK p260: all over the place accent-wise. LibriSpeech: can't really comment on the American examples, but they seem decent.
- jdbernard 7y agoSample 9 is a good example. The pronunciation of "biographer" is consistent even when it should be very different. All of the examples stress the first syllable but an American would stress the second.
- nergik 7y agoAwesome! can’t wait to have some code to play with and start feeding ebooks to produce audiobooks with voices i actually like
- gist 7y agoWill point out that it is cloning after a short sample and with an unknown speaker. So this is great for that type of comparison and in particular when the person listening does not know much or have great experience with the person speaking. Now if you were to take something by a well known person (where there is a great deal of audio) it would be much harder to clone anything other than a really short passage. This would be similar to faking handwriting. Easier to fake one word than to fake three pages. Easier to fake something where you have little to compare a pattern (less can go wrong). Not saying this isn't impressive it is. But it's also a bit of a trick based on the very short clips (both samples and created). I would say that a trained person could do a better fake because they could take into account all the info and be less likely to make a mistake. Now sure you could manually change the AI as well doing the same thing.
- kingkawn 7y agoThis is part of the process of truth being removed from all recording. Soon we will be back to a state where the only certainty is the person we speak to in person
- Hoasi 7y ago> Soon we will be back to a state where the only certainty is the person we speak to in person That is until we are able to tell whether that "reality" is synthesized or not.
- redsymbol 7y agoNot looking forward to the phishing that will exploit this. Going to call my parents today and warn them. If they ever hear something from me that's not adding up, be skeptical, and verify it some other way before taking any action.
- obaid 7y agoThis is awesome (in a crazy way). I was playing with Resemble.ai [1] yesterday and was surprised by how good it was in replicating my voice with just a few minutes of dataset. This technology is going to keep on getting better by the minute. As with any piece of technology, there are always good and bad actors. 1- [Resemble.ai](http://resemble.ai http://resemble.ai)
- moyix 7y agoThis is from 2018 – does anyone know if there are pretrained models and code for this? I found https://github.com/CorentinJ/Real-Time-Voice-Cloning https://github.com/CorentinJ/Real-Time-Voice-Cloning , but the generated audio quality was much worse than the samples here.
- JaRail 7y agoThe biggest missing piece is WaveNet, which is Google's proprietary voice-synthesizer. With only the models trained for this paper, the best you could build is a voice-recognizer. As far as I know, Google only allows people to do TTS with one of their provided voices. I don't expect them to open it up until other companies/academics have achieved similar results. It's too much of a competitive advantage right now. Alexa, Siri, etc all sound like robots compared to WaveNet (google assistant).
- Lucadg 7y agoAt first glance there seems to be more more malicious uses than good ones with voice. Yes, hearing someone dear to me say things he/she never said maybe comforting. Anything else? Maybe some movies with the deceased actor's voice? But what if someone who wants to hurt me sends me files (or phone calls) from the deceased person saying horrible things like: - "I am still alive but left as I was tired of you" - "oh Jan, I love you" [fake phone call from the past, where Jan is a lover which never existed] or even from alive people: - "I am leaving you" - or my live voice saying stuff which gets me fired or in prison. We will never be able to believe voice again...how will we adapt?
- MagnumPIG 7y agoWe can barely trust pictures anymore either. It seems we'll be going back to judging the likelihood of one's actions based on one's reputation, for better or for worse. There soon won't be such a thing as unreasonable doubt.
- Lucadg 7y agoreal life interaction is going to be more and more valuable. So, "we won't need to travel again because of videos calls" is not going to happen any time soon, it seems. And public/private key validation may become invaluable.
- danaris 7y agoIt doesn't have to be about creating audio of specific text with <specific person>'s voice; it can be much more about creating audio of specific text with a wide variety of believable people's voices. I could see this, if it becomes commercially viable, potentially being a huge boon to indie game creation, for instance, since hiring a load of voice actors to record the dialogue for an entire game is vastly more expensive than, say, hiring a bunch of different people to record their voices for 5 seconds—or even, if this ever took off, buying a bunch of samples pre-recorded (or networks pre-trained) for the purpose.
- Dramatize 7y ago
- CraneWorm 7y agoNow we can have audiobooks read by anyone we like! They can direct us to our destination! They can speak at our funeral, being long dead themselves (as long as there is sufficient training material recorded). The future is awesome.
- thomascgalvin 7y agoI legitimately think this could be huge for self-published authors. It takes a skilled professional about forty hours of work to produce an audiobook from a novel-length manuscript. Tacotron could do it in minutes.
- jfengel 7y agoI don't see that coming soon. The voice is one thing, but the performance goes far, far beyond that. Without understanding the text, you can't get good prosody out of a single sentence, much less developing a character for a whole performance. You'd have to "direct" this on a word-by-word basis: "Put the emphasis here. Speed up 10% here. Decrease vocal intensity 25%". You'd end up producing a whole "score", and it would take at least as long as the human actor puts into it. Having done that, it would be amusing to switch it from voice to voice, as a party trick. But the result would still be much poorer than you'd get out of an actor. Really solving the work of an actor is strong-AI-complete.
- jimmydorry 7y agoFeed in enough "good" audio books, and you would probably get something passable for smaller titles.
- sitkack 7y agoAI is separating the talent from the looks across the board. As it is now, one has to both be able to act and look good, but now the AI will enable those who can act, to be re-skinned, literally, into whatever the client needs.
- thomascgalvin 7y ago
- dingoegret 7y agoAnd no one will be able to independently reproduce these results. As with most Google speech research publications.
- hakanito 7y agoIt will be interesting to see if these made-up AI voices can deliver jokes with the same tonality and delivery as good comedians can. I'm just a layman but it feels like a hard problem to solve.
- NoodleIncident 7y agoThe furthest right column in the first table shows that they might be a long way off from getting timing right. The 5-second sample happens to have a comma, at which the speaker pauses; this pause is in most of the generated output, at seemingly random places in the sentence. The one sentence that does have a comma doesn't use the pause, either.
- hindsightbias 7y agoHow long until we have the napster equivalent of voices? Voicester?
- gregcrv 7y agoMaybe after all these years of people disconnecting physically, using more phones and apps to communicate or meet we will go back to the fundamental real world human connection because that's the only one that can be trusted to be genuine. And the digital world will be left out because not trustworthy. Is this where we are heading to?
- kd3 7y agoThis is cool. Hopefully soon I'll be able to use this to do automatic voice overs from written texts using my voice for podcasts and videos. Read pages of text without getting tired.
- admn2 7y agoYikes - don't a lot of financial institutions use your voice as a layer authentication?
- reifnir 7y agoUnfortunately, the source isn't available. I was hoping I could generate my own narration of any book in the voice of anyone I could throw at the trainer. (Heck, even if it was just my own, anything is better than Scott Brick!)
- namaemuta 7y agoI wonder if this could be use on RPG games in which there are so many texts and dialogs that having a recorded voice for all of them is impracticable.
- irrational 7y agoSo, now we can't trust text, images, videos, or audio. Any of them could be fake. What is left?
- dole 7y agoAI-generated scents. After you die, your body odor, sprayed on an article of clothing, as a monthly subscription to your loved ones.
- cs702 7y ago"Hi Jim, it's Jane. How are you? I'm calling you on the phone to confirm the wire transfer instructions I just sent you via email..."
- deleted 7y ago[deleted]
- soulofmischief 7y agoMy bank is going to need to do better than a 6-digit account number and verbal password. Customer service is in for the ride of its life once this rapidly maturing technology is commoditized for criminal enterprise.
- pier25 7y agoIn a couple of years we won't be able to trust any media. I wonder what the cultural implications will be, much like photoshopped models and actors have change the beauty ideals.
- gknoy 7y agoI'm sure we can always trust Eliza Cassan.
- Riccardo_G 7y agoThere are a lot of security features that are being put in place to help us all understand what is real and fake. Of course there is still a lot of work to be done and the technology is very new, but at https://replicastudios.com/ https://replicastudios.com/ work in watermarking audio, as well as authentication of Replica voices and detection of fake, non-authorised replicas is already in progress. Facebook, YouTube, Twitter, and the likes, will then be able to let users know what is using real (actual real voices, or the authenticated Replica voice) or fake voices.
- sebiw 7y agoAnybody else thinking about the scene from the Bourne trilogy where Jason opens Noah Vosens safe using a voice sample he took of him on the phone?
- Gusen 7y agoThis is audio of the President, Donald J. Trump, demanding a $4 billion dollar bribe from child rapists to “take a blind eye” on January 3, 2019. Trump becomes one on January 14, 2019. Also, here is the big reason the major networks do not report any of it. //Download the video, turn the volume all the way up and put head phones on. Note: there is not much to see in the video, the audio is picked up from another [illegal surveillance] system. Trump is on a call from with Henry Porter and Gigi Hadid. See page 63. Bribe demand at 10:18am: 3JanCh3_900-1100.avi https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77YG0Vr/view?usp=sharing https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77... //President of the United States, Donald J. Trump, rapes and kills his first boy at 6:32am. Video link below: 14JanCh3_600.avi https://drive.google.com/file/d/154QvA5hwyHGYIVXtod1ZbsOHFUJNbqZW/view?usp=sharing 14JanCh2_600-700.avi https://drive.google.com/file/d/19UkqmnMwZiWy7xxWngltqwoKLTJL-IZ_/view?usp=sharing //On January 18, 2019 at 8:31am (see page 8) Trump acknowledges the four billion dollar bribe and says: "Let's get it done and get to fucking some kids." Video link below: 18JanCh3_725-.avi https://drive.google.com/file/d/1bVTcGq5Z9oOSAiOQcKYrmuK4TwoNmY1h/view?usp=sharing https://drive.google.com/file/d/1bVTcGq5Z9oOSAiOQcKYrmuK4Two... //A big reason this has not been reported by the major news networks is right here. Lester Holt of NBC Nightly News, apparently a member of the Illuminati since the 1980's, along with ABC Nightly News lead anchor David Muir, stop over to the Porter studio in Buffalo on January 14th, 2019 at 5:00am. They both rape and kill about two dozen boys by 6:00am. Muir starts around 5:15am, then Holt about 5:38am. Multi-billionaire Rupert Murdoch, owner of News Corp & Fox Corporation, takes his turn after Holt. Video links below: 14JanCh3_500-601.avi https://drive.google.com/file/d/1i7NKepeyG_FfdQRrM7KsnFOZOOX3o7UL/view?usp=sharing 14JanCh2_530-600.avi https://drive.google.com/file/d/1NZzgN5ilI7ToroU5cfqMaL4o2u1RwidV/view?usp=sharing Adding to the reason this is not picked up by the media, CBS & Viacom owner Sumner Redstone and Leslie Moonves rape boys following the President. 14JanCh3_700.avi https://drive.google.com/file/d/10XDw6x3ldnnQiq7oIjpdYVENyXaB4aI0/view?usp=sharing 14JanCh2_700-800.avi https://drive.google.com/file/d/1NS_e6AzEZ05wnfljkGMETGU5CWYKfRDp/view?usp=sharing //This is the tip of the iceberg. //Full 88 page PDF [updated 12Nov]: FBI_FinalDraft_26Jul2019_BSchlenker.pdf https://drive.google.com/file/d/1Sj9EN_pHmicKS6rFQlmk67knMdJc9cGk/view?usp=sharing https://drive.google.com/file/d/1Sj9EN_pHmicKS6rFQlmk67knMdJ... //This post will be censored when this account logs off, the posts are "shadow banned". They try to make it look like the post is live, but it is not. Here is an example. https://drive.google.com/file/d/1zxS8JESoIg7uxRkUgdptMsF6SuJedYKz/view?usp=sharing https://drive.google.com/file/d/1zxS8JESoIg7uxRkUgdptMsF6SuJ... \\@ Listen to Speaker of the House, Senator Nancy Pelosi, accept a $3 billion dollar bribe from wealthy high profile child rapists for safe passage to get Asian boys through the border at "Monterrey" on January 17, 2019. //Download the video, turn the volume all the way up and put head phones on. Note: there is not much to see in the video, the audio is picked up from another [illegal surveillance] system. Pelosi call starts at 10:31am. 17JanCh3_949-1100.avi https://drive.google.com/file/d/1eodHu4o5Cm3xEWhDqipSuTj-M1CZUvmE/view?usp=sharing Excerpts of the dialogue: Speaker of the House Nancy Pelosi returns to the Porter camera system at 1031 for a check-in. "Nancy Pelosi is here and she wants $3 billion to keep the border open at Monterrey. $3 billion dollars to keep that shit open do you believe that?" Matthew Porter commentates. Pelosi states 1034: "I think he [Brian Schlenker] needs to be removed. I think we need to get this guy out of here". Speaker Pelosi then agrees to call back at 7pm PST. Gigi Hadid at 1034: "Thanks for calling us. I've got you down for three minutes". Pelosi don't worry about that I've got 3 billion. 1031 Matthew Porter: Nancy Pelosi is on and she wants $3 billion dollars to keep the border open at Monterrey. Three billion dollars to keep that shit open do you believe that? 1033 Nancy Pelosi: I don't think that will be necessary unless you insist. 1033 Donald Reeves?: We insist. 1033 Nancy Pelosi: Ok then I guess we have a deal. 1033 Matthew Porter: Thank you Mrs. Pelosi. 1033 Nancy Pelosi: Please call me Speaker Pelosi. 1033 Nancy Pelosi: We want to make sure you have safe passage at Monterrey. 1033 Matthew Porter: We appreciate that Speaker Pelosi. 1033 Gigi Hadid: I think we may have to scale back a little bit though. 1033 Nancy Pelosi: Gigi I think we'll be just fine. 1035 Nancy Pelosi: God damn it! I want Kamala to get a billion out of yours, not out of mine. 1035 Gigi Hadid: I think we can accommodate you but we need to find out if Monterrey will be open on the 30th of January. 1036 Nancy Pelosi: Of course it will Gigi. 1036 Nancy Pelosi: $3 billion goes a long way Peter. 1036 Peter Thiel: Excellent answer. 1043 Gigi Hadid: I think we need to give Kamala a billion dollars to keep her [happy]. 1043 Matthew Porter: I think we can do that but we need to get her to do something first. 1043 Gigi Hadid: She did. We got her fucking Rahm Emmanuel Monday morning [14Jan] at 235. 1043 Matthew Porter: Perfect, then we're all set. Send her the billion. 1043? Nancy Pelosi: She'll accept the money, I guarantee it. 1043? Gigi Hadid: Nancy thank you for everything. <ch4> 1036 Donald Reeves: Don't listen to her. She will close down the border if it's not there. Make sure she gets the $3 billion. This is the tip of the iceberg. Full 84 page document [updated 12Nov]: FBI_FinalDraft_26Jul2019_BSchlenker.pdf https://drive.google.com/file/d/1Sj9EN_pHmicKS6rFQlmk67knMdJc9cGk/view?usp=sharing https://drive.google.com/file/d/1Sj9EN_pHmicKS6rFQlmk67knMdJ... //*This post will be censored when this account logs off. Posts are "shadow banned". They try to make it look like the post is live, but it is not. Here is an example. https://drive.google.com/file/d/1zxS8JESoIg7uxRkUgdptMsF6SuJedYKz/view?usp=sharing https://drive.google.com/file/d/1zxS8JESoIg7uxRkUgdptMsF6SuJ... \\$ \\New York Senator Charles Schumer rapes and kills one boy looking for his two billion dollar payment from 1700-1730. Schumer at 17:01: "Let's get him out of there, and get to fucking some kids!” Download the video, turn the volume all the way up and put head phones on. Note: there is not much to see in the video, the audio is picked up from another [illegal surveillance] system. Just as a head’s up, there is a vacuum running intermittently in the beginning and some loud noises. \\Representative from New Orleans Steve Scalise rapes and kills three 1725+. Video links below. Each channel has different system users of varying importance, and one may be easier to hear than another. This is explained in better detail in the PDF. 17JanCh3_1644.avi https://drive.google.com/file/d/1caUbmhIf8z264w1MWeOzm0VQIG_h3rtA/view?usp=sharing 17JanCh4_1700-1800_redo.avi https://drive.google.com/file/d/1Md911Z2vXJzJEmNAiJcOkHDKIl15GUmz/view?usp=sharing \\Back on January 13th, a deal to bring over the boys from China, 300 for $375 million through “Monterrey”, is discussed with Barack Obama, Charles Schumer, Henry Porter, and Donald Reeves. Jack Dorsey is there and also discusses possibilities for 500 boys over 300. See pages 37 and 38. You will hear the deal go down later that afternoon between 1:30pm and 3:00pm. Here are the links for the first discussion, which begins around 8:40 with an anxious Obama., the rest are in the PDF: 13JanCh2_700-900.avi https://drive.google.com/file/d/1iUr44-U3dpt0cBlhlOgM071HAtei-g6G/view?usp=sharing https://drive.google.com/file/d/1iUr44-U3dpt0cBlhlOgM071HAte... 13JanCh3_800-845.avi https://drive.google.com/file/d/1m3bBVPra2BEgzmM2QNJsR-JA7rw__oOW/view?usp=sharing https://drive.google.com/file/d/1m3bBVPra2BEgzmM2QNJsR-JA7rw... 13JanCh3_845-954.avi https://drive.google.com/file/d/1XFCDABfGb10oAwCLt7gc4XbsOMxgpKPT/view?usp=sharing https://drive.google.com/file/d/1XFCDABfGb10oAwCLt7gc4XbsOMx... These events were excerpts from this 88 page PDF . It keeps getting censored, but with enough public awareness, they will eventually have to face justice. Please help get this around [updated 12Nov]: FBI_FinalDraft_26Jul2019_BSchlenker.pdf https://drive.google.com/file/d/1Sj9EN_pHmicKS6rFQlmk67knMdJc9cGk/view?usp=sharing https://drive.google.com/file/d/1Sj9EN_pHmicKS6rFQlmk67knMdJ...
- alpineidyll3 7y agoTo not release the source is a a pretty bad distortion of research norms
- arkades 7y agoI once got a call while I was lecturing some students. It was repeated three times in three minutes - I assumed it was an emergency and stepped out. I was greeted by someone explaining that my father had caused a car accident, and they were calling on his behalf. That someone would need to send over some money for repairs or they’d call the police. Sure. They added that their cousin, the driver, is a parolee now holding my father at gunpoint. That if I don’t send them money to make them whole, they’ll kill my father. This was super fishy, you know? But still, with things like “life of a loved one” at stake, it’s hard to call a bluff. I can only imagine what I’d have done if I’d heard my fathers voice pleading for help. They might have been able to get any amount of money out of me. Well, if my father hadn’t passed away nine months prior. They were not delighted to hear that.
- toxicFork 7y agoHow do you even prepare for something like that... Do we need to assign identifying keywords to each other when we leave home so we know we are really ourselves? Like a vocal pgp?
- robbiemitchell 7y agoI told my wife that if I ever mention <redacted> while on a phone call, she should know that I am in trouble an unable to speak freely. Sound like we'll all need more things like this eventually :(
- elefantastisch 7y agoIt would make sense to have another word that indicates it is genuinely you and you are genuinely speaking freely.
- baroffoos 7y agoThat would solve the problem of having to find a word that you would never normally use but could slip in to a sentence normally.
- dation 7y agoNow a politician can deny any sound bite. "They just deepfaked my voice!"
- agentultra 7y agoImpressive but they still sound like robots imitating humans. I can only imagine the chaos this could cause, if used by bad actors, as it continues to improve. If someone took my voice I'm not sure that my partner would know it wasn't me. That would enable all kinds of social engineering attacks.
- Enginerrrd 7y agoExactly what I was thinking. We already have a problem with scammers claiming to be relatives who need some quick cash wired over. Imagine how much more effective that could be if it actually sound indistinguishable from a loved one.
- joshmarlow 7y agoThere's a potential upside to malicious uses - synthesized voices (and deepfakes) can give victims of revenge porn some plausible deniability. This would hopefully take some of the sting out of that experience.
- deleted 7y ago[deleted]
- luxpir 7y agoI wonder if we'll need a PGP signature for every kind of recording we might make in the future.
- epx 7y agoOne thing is, voice over phone is so compressed that it actually took a long while for this kind of voice cloning (and associated frauds) are all over the place. We are going to need 2FA over voice communications :)
- Riccardo_G 7y agoWhat it is doing is not really cloning, but because it was trained on 18k different voices, it actually finds one that is closest to yours, and uses that one. It can do a bit of interpolation to create an embedding which is closer to your own, but only if it is well represented by a mix of other voices. Real voice cloning like at https://replicastudios.com/ https://replicastudios.com/ can take just a minute or two of audio, and it does a fairly good job, and it is always improving. With more audio you start being able to also play with emotion and styles, which is very cool!
- ehsankia 7y agoWas it 18k voices or samples? Also, is it finding the closest voice, or is it a continuous parameter space formed from the voices?
- JaRail 7y agoI'm not really sure where you're getting this. It doesn't pick a specific voice from a database to use. From their introduction: "Our approach is to decouple speaker modeling from speech synthesis by independently training a speaker-discriminative embedding network that captures the space of speaker characteristics and training a high quality TTS model on a smaller dataset conditioned on the representation learned by the first network." Section 2 of the paper explains how it works. Two minute papers also goes through it if you'd prefer a video. Link: https://youtu.be/0sR1rU3gLzQ https://youtu.be/0sR1rU3gLzQ
- sillysaurusx 7y agoThey’re saying that underrepresented voices will have trouble being modeled. That matches my experience with this project: for example, I had a very tough time cloning female voices compared to nerdy-sounding / deep male voices.
- zamubafoo 7y agoIt's more that the sounds produced during the recordings didn't cover the entire spectrum of possible sounds, so the model had to estimate their sound. All you really need is a paragraph which you can have the person read to get sufficient coverage or just enough recordings that it's not an issue anymore.
- kevin_thibedeau 7y agoThere was an old Piece on Headline News 20 years ago where someone had done this with Whoopi Goldberg's voice. Never heard about it since. Presumably it went black.
- undershirt 7y ago“When you see something that is technically sweet, you go ahead and do it and you argue about what to do about it only after you have had your technical success.” —Oppenheimer
- robertjwebb 7y agoThe thing is, these topics have already been discussed by philosophers! Questions of authenticity, human subjectivity, reproducibility etc are not new. But for the average joe and the non-philosophically-inclined techie, the thing has to actually exist before they start really talking about it.
- x220 7y agoJordan Peterson got it right months ago. "It’s hard to imagine a technology with more power to disrupt. I’m already in the position (as many of you soon will be as well) where anyone can produce a believable audio and perhaps video of me saying absolutely anything they want me to say. How can that possibly be fought? More to the point: how are we going to trust anything electronically mediated in the very near future (say, during the next presidential election)?" https://nationalpost.com/opinion/jordan-peterson-deep-fake https://nationalpost.com/opinion/jordan-peterson-deep-fake
- jasonbourne1901 7y agoIn the future moms will no longer complain that their sons never call!
- i2shar 7y agoWow. So is that why I am getting incessant spam calls and they only need to hear me or my voicemail greeting for 5 seconds to be able to impersonate my voice ever after?
- solveq1 7y agowhy do we need this kind of technology? cheating? It seems anti-human
- sillysaurusx 7y agoI used this repository to make Half Life’s Dr. Kleiner sing “I am the very model of a modern major general”: https://twitter.com/theshawwn/status/1171806394783326208?s=21 https://twitter.com/theshawwn/status/1171806394783326208?s=2... https://www.youtube.com/watch?v=koU3L7WBz_s https://www.youtube.com/watch?v=koU3L7WBz_s Then @jonathanfly deepfaked Dr Kleiner’s face onto a live performance of the song, which was hilariously unexpected. The AI twitter scene is awesome: https://twitter.com/jonathanfly/status/1171907301231513605?s=21 https://twitter.com/jonathanfly/status/1171907301231513605?s... There is some promising new work in the GitHub issues. For example, someone has been training on ~10,000 additional speakers.
- johnsonjo 7y agoI was literally just researching tts (text to speech) programs yesterday and I believe Mozilla’s open source (open source in this case meaning weak copyleft) TTS [1] also uses Tacotron and is trying to implement multi speaker tts currently [2]. I literally just posted Mozilla’s TTS to hacker news [3] without even seeing this which made me experience a bit of the Baader-Meinhof Phenomenon [4]. [1]: https://github.com/mozilla/TTS https://github.com/mozilla/TTS [2]: https://github.com/mozilla/TTS/blob/master/README.md#major-todos https://github.com/mozilla/TTS/blob/master/README.md#major-t... [3]: https://news.ycombinator.com/item?id=21532189 https://news.ycombinator.com/item?id=21532189 [4]: https://en.m.wikipedia.org/wiki/List_of_cognitive_biases#Frequency_illusion https://en.m.wikipedia.org/wiki/List_of_cognitive_biases#Fre...
- accounn 7y agoGoogle scam & spy business in plain sight.
- injb 7y agoThey turned the Scottish accent into an English accent. The American ones are very convincing though.
- KW1547132 7y agohewlk