26 ms·
VALL-E: Microsoft’s new zero-shot text-to-speech model
- kybernetyk 4y agoDoes this mean I could finally speak English without my heavy accent?
- optimalsolver 4y agoThatsa correcto.
- kybernetyk 4y agoI don't speak Italian ;)
- nullsense 4y agoZattsu Raito?
- Traubenfuchs 4y agoAccents can be minimized through dedicated training. After being ridiculed for my horrendous English pronunciation I watched hours of English movies and repeated every single sentence I heard until it sounded right.
- russianGuy83829 4y agoSigh.. Now we'll need voice changers when calling people/institutions we don't trust
- bamboozled 4y agoOh that's great news \s Do other people read these types of headings and just think immediately about how freaking scary this stuff is going to get...if it's actually accurate ?
- sendfoods 4y agoYeah, I am increasingly nervous about some point in the future where you cannot trust any digital medium because of deep fakes, NERFs, voice cloning... The only possible solution I have seen being talked about is digitally signing any and all "real" content, similar to GPG/SSH.
- ravivyas 4y agoPhotoshop and minor video manipulation is enough to trick people into believing fake news, this will make it harder. I see political parties doing simple edits to make people believe anything, this will push it multiple notches higher.
- jacquesm 4y agoThat they can do so without consequences is almost as scary as that they can do so in the first place.
- willnonya 4y agoFraud, slander etc are already illegal. There are consequences for crossing these lines.
- teekert 4y agoYou really have low exceptions for humanity. Most people are not complete idiots you know. I think your opinion is pretty elitist. Or do you think you yourself will fall for this as well?
- andrewstuart 4y agoI’m really skeptical about TTS. There’s lots of theoretical and academic and research lab stuff that supposedly is quantum leaps forward in TTS. However, all the commercial offerings sound like TTS and never match the breathless hype. Try them out and you can tell within seconds it’s a robot talking.
- sschueller 4y agoI have to disagree. The SBB (Swiss Rail) is now using a quite sophisticated TTS system [1] that sounds very clean and has a Swiss German accent in the high German its talking (Zürich accent based which is what most of the complaints are about). The old system was built using over 10k recording which was a enormous task The system now is able to announce pretty much anything including reasons for delay etc. and it does not sound like a bunch of recordings attached to each other. I am hoping it will be expanded eventually to switch accents depending on the region just how it already switches to French or Italian depending where you are. [1] https://www.tagesanzeiger.ch/so-klingt-die-neue-stimme-der-sbb-832034335687 https://www.tagesanzeiger.ch/so-klingt-die-neue-stimme-der-s...
- ale42 4y agoExcept that... while the German-speaking one sounds relatively well, I am definitely unhappy with the new system in French. It sounds more unnatural (and harder to understand in certain cases) than the old system. Maybe it's just a lack of tuning of the French version vs. the German one, but still...
- sschueller 4y agoI agree, I hope the fix that soon. I think the product they are using is from Germany which may explain the quality difference.
- ale42 4y agoDo you know what the actual product is?
- weinzierl 4y agoI had planned to play around with TorToiSe[1] next weekend and already watched some videos. There it looks like all you have to do, is to offer you own voice samples to the system and no separate training seems to be required. TorToiSe is slow to synthesize, so it doesn't beat the 3 seconds but can anyone confirm that these models really don't need an extra training phase to clone a voice? [1] https://github.com/neonbjb/tortoise-tts https://github.com/neonbjb/tortoise-tts
- reubenmorais 4y agoCorrect, that's what zero-shot means, no training steps.
- oslem 4y agoThat’s correct. However, the 3 seconds refers to the minimum amount of audio required for the reference audio, not how long it takes the mode to synthesize.
- paulluuk 4y agoI've been voice-cloning using tortoise-tts and I'm very happy with the results, but it is indeed very slow. It's also free and open-source though.
- r_hoods_ghost 4y agoA relative of mine recently died from bulbar ALS. By the time she had the diagnosis her voice had already changed and weakened significantly so she couldn't get a decent recording to use with a text to speech synthesizer. Something like this could potentially help people like her or those who lose their voices in traumatic accidents. Even if you do have the time to do it, training a current TTS engine in your voice takes a significant amount of time and the results are often poor.
- tgraham 4y ago100%. The tech my father tried to use in the last year of his MND was so poor (effort to train it, reality of what it delivered- jilted voice). The impact on his quality of life - imagine not being able to communicate at all - would have been massive were it better.
- voakbasda 4y agoThis makes me wonder whether we could create a standard monologue that someone could record, which provides a complete set of training data for that individual. Something about a quick brown fox and a lazy dog would be apropos here, but I suspect the length would be more Shakespearian than that simple typographic clever sentence. I expect it will be a while until we can fully utilize that data, but I have to imagine that something could be done today to preserve my voice (while I am still in my prime). Effectively, this would be a sort of vocal cryogenics, betting that we can do something today that will allow us to take advantage of future technology.
- r_hoods_ghost 4y agoThis is basically what you do currently for a TTS engine if you have ALS or similar. The search term you want is "voice banking". You are given a long list of words and sentences, often complex, to read out that have all the different sounds and then these are re combined by the software. The problem is that by the time you know you need this, you often already have speech problems and so making clear sounds is difficult. Also if you're like my relative who was trilingual you would need to do it in all three languages using the current system. She got a half way decent voice bank in her native tongue, but it was still noticeably slurred. She didn't even attempt it in her second and third tongues.
- alanwreath 4y agoanyone know what's up with the sudden uptick in AI assisted everything? - ChatGPT - DALL-E - VALL-E - Stable Diffusion maybe it's just a reflection of my interest being peaked with AI junk and google ads -- but I feel like I'm seeing it more and more even in HN.
- gl-prod 4y agoIt's the new hot topic?
- jddj 4y agoBreakthrough tech doing breakthrough tech things
- Thorentis 4y agoOne of the perks of crypto losing value. GPUs finally being used for breakthrough research, rather than pyramid schemes.
- nindalf 4y agoThis claim feels truthy, but is it true? Most of the big models were being trained on specialised hardware like tensor chips right? And the biggest drop isn’t because crypto is worth less, it’s because Ethereum doesn’t use proof of work since November (Bitcoin hasn’t used GPUs for years). The explosion in novel AI models we saw last year predates this change.
- bfgoodrich 4y ago[dead]
- lajamerr 4y agoMost big AI is trained on Nvidia GPUs but usually not the standard consumer ones found in the GeForce line-up. Instead it's usually their data centre GPUs like the current A100 or soon to be H100 that's just hitting the market. Google does have their TPUs(Tensor Processing Units), however it is not cost efficient budget wise, so unless you have some kind of deal with Google or compute credits it doesn't make sense. They have pods upon pods of TPU clusters though so the main selling point of TPU training is that you can get your training done really fast with just the ease of scaling your workload to more TPUs. So if you needed a big model like GPT-3 trained in a single day, you could spend an ungodly amounts of money and get it done with Google TPUs. Otherwise if you can wait weeks or months you can go with the standard Nvidia data centre solution and it'd be cheaper at the end by a significant margin.
- dubcanada 4y agoI listened to the 3 samples, and I must say some of it is quite close and some of it is completely wrong with how I would expect that person to sound saying those words. Like the first one "just his scribbles that charmed me" sounds so weird compared to how the sample sounds. Second one, sounds very close but again "just his scribbles that charmed me" sounds off and wrong. His "scrouples? that charmed me". Third one as well, it's very up and down (not sure the correct science words for that type of speaking), "Dynamo and lamp.... Edison realized". The second one is completely flat and seems computer generated. Overall these don't seem very good to me at least. It's clearly not to the level of some other AI coming out where it is very difficult to determine the human part, I could easily pick up the human and generated version from these samples.
- wmwmwm 4y agoI think it is actually meant to be "scruples" - so it sounds pretty accurate to me: https://www.ibiblio.org/ebooks/James/Turn_Screw.pdf https://www.ibiblio.org/ebooks/James/Turn_Screw.pdf (see p4)
- dubcanada 4y agoThat's hilarious, I thought it was supposed to be scribbles lol... scruples makes more sense. But I guess this just further emphases what I said. I am a native English speaker and I had no item what 6 samples were saying...
- icepat 4y agoYes, there's definitely an uncanny valley effect on these voices. There's something subtly not right about them, and I suspect if you were to hold a conversation with one, you'd catch on that something was wrong. The uncanny valley makes it more spooky to me. Like a reanimation sort of thing.
- 24effects 4y agowhy did they pick such a batshit thing for the ai to say.. I don't understand. Still laughing at scruples.
- nugget 4y agoI'm curious how all these advancements in AI will impact KYC and identity authentication. It's already easy to scrape OSINT to pull the answers needed for most people's knowledge based authentication sequences. Will we hit the point where fake passports, IDs, and biometrics (including voice prints here) can be replicated undetectably? If so, what will become the standard for identity authentication?
- pifm_guy 4y agoKYC isn't about stopping bad guys doing stuff. It's about stopping the government from shutting you down.
- acdha 4y agoI’m assuming it’ll come down to two things: more reliance on in-person checks and eventually pushing more towards digital signatures but the latter is complicated in the U.S. by politics. It wouldn’t be insurmountable to deploy national ID cards like Estonia from a technical perspective but we have a non-trivial number of people who object to that on religious grounds so I’d expect we’ll have some kind of private sector multiple standards mess for years.
- kybernetyk 4y agoMaybe governments finally start implementing public-key cryptography with their chip-enabled IDs and passports?
- choeger 4y agoIs it just me or is "AI" focused very much on fooling human perception, lately? AFAIK, we have no deterministic algorithm that can tell us whether synthetic language sounds "human", have we? So essentially, that model has been trained to fool human perception. Similarly, ChatGPT is not trained to output sensible and meaningful statements but rather statements that appear to be to a human reader. Would not not be time to measure a model's success on the actual job? Like feeding a simulator with actual data from real-world traffic scenarios and running Tesla's, or any other company's, autopilot in it?
- Uphill4298 4y agoIt's a varied area of research, we do plenty of things. Training things on a simulator, and then using that to transfer domain to the real world is a fairly typical application.
- isthisthingon99 4y agoAI is focused on creating electronic humans that are never tired and can do low skill work with some high level directions. It seems like we will achieve this goal, but the companies will own the electronic humans.
- yoavm 4y agoPerhaps it's us that are obsessed about perception rather than substance though? I wonder if it's different from asking a child to memorize for an exam, or investing time in a stylish presentation, etc. Seems like we're very often interested in something that looks like the job rather than the job itself - maybe because it's more easily measurable? We then took this skewed ambition and developed AI after it.
- krisoft 4y ago> So essentially, that model has been trained to fool human perception. Is there any other sensible goal function for a text to speech model? > Similarly, ChatGPT is not trained to output sensible and meaningful statements but rather statements that appear to be to a human reader. Almost certainly not true. If they could they would make it output sensible and meaningful statements all the time. > Like feeding a simulator with actual data from real-world traffic scenarios and running Tesla's, or any other company's, autopilot in it? Do you seriously think that self driving car companies are not doing this already?
- knaik94 4y agoThere is an open source implementation of these features in Pytorch: https://github.com/lucidrains/audiolm-pytorch https://github.com/lucidrains/audiolm-pytorch
- paulluuk 4y agoI wish they had included their training weights though. This can only be used if you happen to own a huge audio corpus and have a lot of money.
- bob_theslob646 4y ago>This can only be used if you happen to own a huge audio corpus and have a lot of money. May you elaborate on that? Do you mean that you need a large training set of your voice and you need $$$ in order to train the models on an expensive GPU?
- paulluuk 4y agoSo, looking at it again I see that the audio corpus is available for free (openslr.org, 60GB for 1000 hours of speech), however I suspect that training the model on that amount of data would take insane amounts of time on a single GPU. Instead, usually companies train such models in the cloud. GPT-3 for example used 800 GB of training data and cost about 5 million USD to train. Extrapolating from that, I guess that the same setup would cost 375,000 USD to train (although I assume that this model has waaaaay fewer parameters making it a lot cheaper -- but I can't seem to find how many parameters it has). If someone else already spent that money to train the model, then you could just take the "training weights", feed them into the model, and it would be as if you had already trained it -- at which point you'd only need to provide your own voice and retrain it on your own GPU for a short time. I'm by no means an ML expert though, so I could be totally wrong on this.
- morrisjm 4y agoJames Betker in the tortoise-tts repo, which is similar, says he spent $15k for his home rig. I'm not finding right now how long it took to train the tortoise model but feel like I read him say weeks/months somewhere. Obvs all kinds of variations depending on coding efficiency and dataset size, but another datapoint https://nonint.com/2022/05/30/my-deep-learning-rig/ https://nonint.com/2022/05/30/my-deep-learning-rig/ https://github.com/neonbjb/tortoise-tts https://github.com/neonbjb/tortoise-tts
- altcognito 4y agoWould be awesome to pair this with near real time language translation. I get from the demo it seems that this is still very language specific, but I assume it will happen sometime.
- fdalvi 4y agoPrevious discussion here: https://news.ycombinator.com/item?id=34270311 https://news.ycombinator.com/item?id=34270311
- deleted 4y ago[deleted]
- garyclarke27 4y agoHSBC in the UK used to advertise Telephone banking with security just based on speech recognition. I wonder whether systems like that could be fooled by this?
- pjc50 4y agoMy employer had a project to look at phone unlocking with voice authentication. While we had a number of interesting techniques for anti-faking, the problem was the base error rate was about 1/10,000 even without adversarial considerations.
- Tade0 4y agoBiometric identification via voice is mostly hokum. My education is in biometrics and our undergraduate seminar group had a student and his supervisor with essentially identical voices. But that's just anecdata - the human voice doesn't carry a lot of unique information and on top of that it changes over time. In biometric identification the iris is king. 3D face scans are a distant second, fingerprints on the border of usefulness and the rest like gait, voice, keystrokes etc. get rediscovered every decade or so just to, again, not yield results.
- robjan 4y agoHSBC Hong Kong is actively promoting this. Just say "I will need your help with something" and you're in.
- cactusplant7374 4y agoSomeone will eventually release an open source model, right?
- alexb_ 4y agoHope that 15.ai finishes soon.
- MarcScott 4y agoThis would have made Sneakers a much more boring movie.
- reverseblade2 4y ago- Hey Janelle, what's wrong with wolfie? I can hear him barking. Is everything okay? - Wolfie is fine dear. Wolfie's just fine. Where are you?
- tromp 4y agoI smell a terminator...
- O__________O 4y agoRelated Clip: https://youtube.com/watch?v=dGowjtiu908 https://youtube.com/watch?v=dGowjtiu908
- optimalsolver 4y agoFor those who don't know, the woman playing his mother is "Vasquez" from James Cameron's previous film, Aliens.
- higgins 4y ago“Hey Vasquez, have you ever been mistaken for a cybernetic organism?”
- svth 4y agoNo. Have you?
- frereubu 4y ago"Hey, Vasquez, have you ever been mistaken for a 17th century Spanish painter?"
- keithalewis 4y agoWhy drag Vasquez into this?
- ad404b8a372f2b9 4y ago
- vault 4y agoCan someone please transcribe what "Speaker prompt" in Example #1 is really saying? I can't get "When I love making babies" out of my head! I reduced speed to 0.5X and understood the final, "maybe suspended but".
- sgerenser 4y agoI heard “whereby lovemaking may be suspended, but…”
- hef19898 4y agoAh, I have serious Demolition Man vibes now.
- kmill 4y agoThanks for confirming -- I didn't trust my own ears for such a strange fragment of a sentence! It turns out it comes from a book called "The Foolish Dictionary: An exhausting work of reference to un-certain english words, their origin, meaning, legitimate and illegitimate use, confused by a few pictures" by Wurdz and Goldsmith. (Talk about nominative determinism -- a dictionary by Wurds?) Full entry: HAMMOCK From the Lat. hamus, hook, and Grk. makar, happy. Happiness on hooks. Also, a popular contrivance whereby love-making may be suspended but not stopped during the picnic season.
- swyx 4y agois this tech usable in any way? without releasing the code or the model how is this not vaporware?
- iso1631 4y agoGood News Everyone, I'm a Horse's Butt https://www.youtube.com/watch?v=M1D9WEL7PKQ https://www.youtube.com/watch?v=M1D9WEL7PKQ
- ipsin 4y agoAre these text-to-speech models manually controllable in terms of prosody, etc., or is it all transformer-based text-to-audio? I've followed some of the research on prosody transfer, etc., but it still seems bad in the TTS systems I've heard.
- naillo 4y agoThis should probably link straight to page of the paper https://valle-demo.github.io/ https://valle-demo.github.io/
- waynenilsen 4y agoPerhaps digital signatures will help with authenticity issues. It may become necessary. Transcoding presents an issue I wonder how it may be solved
- 152334H 4y agoMore samples available on their github page: https://valle-demo.github.io/ https://valle-demo.github.io/ Personally, I find that their samples aren't near anything I'd call "dangerous". I cross-compared the baseline examples to the VALL-E ones when the paper dropped, and found several that were garbled in the usual robotics sounding TTS failures. Probably a good thing that people are getting alarmed before a true indistinguishable voice cloner exists, though.
- 323 4y ago> before a true indistinguishable voice cloner exists At the rate things are progressing that's about two years away.
- chpatrick 4y agoOne or two papers down the line...
- nemacol 4y agoI can hear their voice > "Dear Fellow Scholars, this is Two Minute Papers.... "
- infinityio 4y ago...but is it actually their voice, or just a simulation of it?
- llagerlof 4y ago"What a time to be alive!"
- coding123 4y agoI think as soon as someone embeds the "excitement" or "sadness" and other emotions as training. Or perhaps combine it with GPT's abilities. There are no voice inflections. It's too dry and non-compelling. It's very much like a non-emotional programmer right now.
- 4y ago
- swader999 4y agoYes, this is the CEO and I do need you to wire that money. C'mon Frank (from accounting), you need to act more promptly on these urgent requests
- Pxtl 4y agoOne more step deeper into the post-truth era.
- Kuinox 4y agoThe generated voice has the same creepiness fake AI voice has in movies. It also has the same monotone tone that there is in some dystopian movies (For some reason it make me remember of Bladerunner, but I don't remember a narrator voice).
- jxramos 4y agoFor another angle what exactly is the source for our distinct voices to begin with? Are everybody’s vocal chords distinct in some way like a fingerprint or something or is it mostly governed by our baseline neural control considering how people can frequently impersonate others ala comedians to some degree of accuracy where it’s funny.
- nullsense 4y agoConsidering a given person's voice would sound different if they were brought up speaking a different language, yet all the speakers of that language have distinct voices, I'd say it's a bit of column A and a bit of column B.
- jxramos 4y agothat's a good point too, accents can creep over from first learned languages of a different tongue.
- jimmyjazz14 4y ago"Your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should."
- swader999 4y agoYes, this is Mike Smith's father Steve, my son won't be attending school the rest of this week. We're flying back east to visit our relatives.
- ghoshbishakh 4y agoCan someone try with David Attenborough 's voice?
- swader999 4y agoCan someone merge this with Chat GPT so I don't have to attend anymore zoom meetings?
- mdhb 4y agoI wonder to what degree some of these issues can be addressed with cryptographic protocols. In some sense I feel like we already have good solutions in place when dealing with this problem in other contexts. We can for example get some guarantees about “who wrote this code” with signed git commits for example. The problem is a lot of our commonly used communication protocols were never designed with them in mind.
- nicce 4y agoIt is very possible and in some areas it is already been used. For example there are video cameras which sign data in realtime for 4k resolution already. So you would need microfone with TPM chip and you are good to go. You just need that video player which can verify the data.
- losthobbies 4y ago"My voice is my passport. Verify me?"
- stemlord 4y agoI remember Lyrebird did this back in 2017. They used to have a free-to-use interface on their site to speak a phrase then listen to a text-to-speech output of your voice. Assuming Microsoft improved it somehow?
- Waterluvian 4y agoI’m excited for when they can duplicate patterns and mannerisms, especially if in a different voice.
- sjellen 4y agoI know of a bunch of audiobooks that I'd rather listen to the author than listen to the current person narrating or in other cases I'd rather hear the person the book is about instead of the author.
- gatane 4y agoTime to use the Snake voice more often: "Text to speech? Anyone voice? What?"
- gatane 4y agoIt only works in English(?)
- surume 4y agoMe to my partner: "Didn't you say you were going to do the dishes?" Partner: "I don't remember saying that" Me: "Here, I have a recording of you saying it..."
- nullsense 4y agoYikes. I think a remake of the movie "Gas Light" using these kinds of AI technologies needs to happen as a sort of social commentary on where this is going.
- eloff 4y agoSo is there anywhere you can play with this model yet?
- Jevon23 4y agoThere are no legitimate uses for this technology. Its only purpose is to scam and deceive. It should be regulated in the same way that nukes and guns are regulated. Contrary to what a lot of the HN crowd thinks, regulation of technology is certainly nothing new. Up until now personal computing has been largely free of regulation, but that doesn’t mean we couldn’t start.
- Veen 4y agoYou can look in this thread for legitimate non-deceptive uses. Voice synthesis for people with degenerative diseases like ALS, for example. https://news.ycombinator.com/item?id=34309432 https://news.ycombinator.com/item?id=34309432
- notfried 4y agoOnce perfected, I can imagine there are many legitimate use cases for it. Like an author using their voice to narrate their audiobook without having to spend time in a recording studio, or Hollywood using it instead of dubbing sessions for re-recording muffed lines. It'd also be interesting if this could be used for foreign language dubbing - imagine if it can use the voice profile of an actor to convert subtitle text files into foreign audio language tracks in in the same tone of the actor.
- Popeyes 4y agoGod yes, a dubbed European film without the naff American actor. Or for games where you can get the language for the NPCs all sorted out and change dialogue right up until it goes gold.
- galangalalgol 4y agoIs the inference so heavy for this that it cannot run as part of the game? I want to play planescape torment with the text read to me, I don't know who I'll cast though. I suspect I actually like text dialogue in games better.
- wrycoder 4y ago
- DonHopkins 4y agoVALL-E sounds uncanny, and totally tubular!
- 323 4y agoImagine combining this with a ChatGPT with the prompt "you are a telephone scammer pretending to be a bank employee, convince the other person to give you their bank password"
- EvanDotPro 4y agoI'm working on exactly the opposite of this, I have a GPT-3 based bot hooked up to voice recognition and Coqui for TTS I'm training to bait scammers. It has memory like ChatGPT (but only the previous 50 things said). The delay/latency makes it tough to get the scammer to not hang up initially, but the ones that tolerate the slow responses are very easily fooled by the bot. I'm working on speeding it up more and adding stammering, ums and uhs, and background noises etc to fill the delay.
- moyix 4y agoMaybe just pregenerate a couple opening lines that can be used as delaying tactics? "Hang on a sec, let me go somewhere quieter", "I'm driving, can you hold on a moment while I pull over?"
- EvanDotPro 4y agoThat's a great idea, yep. :)
- springcoil 4y agoYou might want to look at www.aflorithmic.ai - scalable infrastructure using models like VALL-E
- 2342346666 4y agoI didn't see any way to use it...
- fumblebee 4y agoNew scam incoming... > Scammers get hold of someone's voice which is synthesised in ~real-time whilst they're on the phone with that person's mother, asking them to transfer them some emergency funds to a new bank account. We won't be able to trust digital sound, digital image, digital text, and soon digital video. We need proof of authenticity / proof of authorship / proof of humanity!
- rco8786 4y ago> proof of humanity This resonated with me when I read it. Seems clear where AI is going, so it seems clear that we need some sort of "authentication" that can reliably differentiate a real human from an AI one.
- boredumb 4y agoExciting to see ML develop in ways that will enhance accessibility for people. I imagine being able to train a screen reader with your own voice (or voice of your choosing) would be a huge plus for vision impaired folks.
- Havoc 4y agoHmm. I wonder if this can be used to make a home assistant sound like someone
- Tao3300 4y agoI'd like to get off the ride, please.
- talhof8 4y agoReally scary to be honest… Making things much easier for scammers. Voice phishing and social engineering is now easier than ever.
- lannisterstark 4y agoor...get this this will enhance accessibility to a vast number of people with disabilities. Also imagine reading your books/articles in voice of your favorite narrator. A normal person will have to work really hard to do a 1:1 real time voice obfuscation with the processing it'd take. ---- Why are you lot always doom and gloom and small-minded, is beyond me.
- talhof8 4y agoIt’s not about being doom and gloom. It’s the opposite of being small-minded. I like all of the above use cases you suggested, I like science advancements. I’m sure this will help plenty. But, at the same time, we should be really careful and aware of what we’re creating.
- tropicalbeach 4y agoBecause you're not thinking 10 years out. At a certain point you will be able to copy any voice and any video of a person in realtime. It will be as simple as downloading an app. When AI has scanned your whole life's details and it can be found by anyone there will be no privacy left. Nothing will be trusted anymore.
- btseytlin 4y agoI would love to hear David Attenborough's voice training VALL-E so that we can forever narrate "planet earth" like tv shows with his voice.
- jesuspiece 4y agoThanks MSFT for making my job of phishing people easier :)
- r-zip 4y agoSerious question: do the people who work on this topic think they’re doing a good thing?
- jmartrican 4y agoSo if you get a call from a number you do not know, maybe we should NOT talk and give them our voice which they will record and use to make new speech to scam our loved ones.
- jmartrican 4y agoWill probably have to give my mom a secret word that only I know that I need to say to her so she knows its me and not a scammer using my voice.
- theptip 4y agoIt’s not a bad idea, but you can already do this kind of check with shared knowledge. “Where did we go for vacation when I was a kid?”, “where did we eat for dinner last time we saw each other” Etc.
- morrisjm 4y agoOpen source tortoise-TTS has been able to do this for 6+ months now, which is also based on the same theory as DALL-E. From playing with tortoise a bit over the last couple of weeks it seems like the issue is not so much accuracy anymore, rather how GPU intensive it is to make a voice of any meaningful duration. Tortoise is ~5 seconds on a $1000 GPU (P5000) to do one second of spoken text. There's cloud options (collab, paperspace, runpod) but still https://github.com/neonbjb/tortoise-tts https://github.com/neonbjb/tortoise-tts
- jordibc 4y agoI think you mean https://github.com/neonbjb/tortoise-tts https://github.com/neonbjb/tortoise-tts (missing last "s")
- morrisjm 4y agofixed thx
- NayamAmarshe 4y agoIs the link wrong?
- ShamelessC 4y agoHeh you might want to use an equivalent gaming GPU for the price comparison. Surely a thousand dollars spent on an RTX 4000 series card (Hopper) would outperform a P5000? I agree though, Tortoise TTS did a lot of similar work IIRC by a single person on their multi-GPU setup. Really impressive effort. Did they get a citation? They deserve one. edit: reading other comments it seems there is a misconception that the model takes 3 seconds to run? That isn't the case - it requires "just" 3 seconds of example audio to successfully clone a voice (for some definition of success).
- morrisjm 4y agortx4000 only has 8gig memory which means reducing the batch size (much slowness) and/or how much text you can give it at once (meaning you have to break up text chunks not at sentence breaks) rtx5000 maybe but not sure how much of a value improvement there is
- _greim_ 4y agoThere's plenty to be afraid of, but legit applications as well, for example automated announcements and voice menus where you can't pre-record every possible combination of things to be said.
- gdubs 4y ago"My voice is my passport."
- fudged71 4y agoI understand these examples are zero-shot with short samples--which is impressive, but would the output quality improve significantly with longer input samples? For example I noticed it couldn't quite pick out the accent on some samples because they were so short. But if the model had more example words to hear then I'd think it would accurately understand the accent..
- dang 4y agoRecent and related: VALL-E: Neural codec language models are zero-shot text to speech synthesizers - https://news.ycombinator.com/item?id=34270311 https://news.ycombinator.com/item?id=34270311 - Jan 2023 (136 comments)
- kxperience 4y ago[dead]
- kxperience 4y ago[dead]
- MollyRealized 4y agoGiven its name, I was quite surprised not to hear it sounding like this: https://youtu.be/R5Q1yVLSR3I?t=17 https://youtu.be/R5Q1yVLSR3I?t=17
- Pigalowda 4y agoDidn’t Deep Voice from Baidu claim this several years ago? Was that a legit claim or is MS playing catch up?
- lobo_tuerto 4y agoHow long before we have pretty good AI bards? They'll sing never written verses, non-existent sounds in a velvet voice.
- iamcostas 4y agoIt will be interesting if vall-e could express emotions like fear or love by the the tone or speed of the voice. This will be even more scary
- deleted 4y ago[deleted]