3 ms·
I've built a lot of celebrity text to speech models and host them online: https://vo.codes https://vo.codes It has celebrities like Sir David Attenborough and
by echelon 6y ago
I've built a lot of celebrity text to speech models and host them online:
https://vo.codes https://vo.codes
It has celebrities like Sir David Attenborough and Arnold Schwarzenegger, a bunch of the presidents, and also some engineers: PG, Sam Altman, Peter Thiel, Mark Zuckerberg
I'm not far away from a working "real time" [1] voice conversion (VC) system. This turns a source voice into a target voice. The most difficult part is getting it to generalize to new, unheard speakers. I haven't recorded my progress recently, but here are some old rudimentary results that make my voice sound slightly like Trump [2]. If you know what my voice sounds like and you kind of squint at it a little, the results are pretty neat. I'll try to publish newer stuff soon, and that all sounds much better.
I was just about to submit all of this to HN (on "new").
Edit: well, my post [3] didn't make it (it fell to the second page of new). But I'll be happy to answer questions here.
[1] It has about ~1500ms of lag, but I think it can be improved.
[2] https://drive.google.com/file/d/1vgnq09YjX6pYwf4ubFYHukDafxPNeEpH/view?usp=sharing https://drive.google.com/file/d/1vgnq09YjX6pYwf4ubFYHukDafxP...
[3] I'm only linking this because it failed to reach popularity. https://news.ycombinator.com/item?id=23965787 https://news.ycombinator.com/item?id=23965787
- dang 6y ago(These comments originally were in https://news.ycombinator.com/item?id=23965106 https://news.ycombinator.com/item?id=23965106 but I've moved them) We'll re-up that thread (see https://news.ycombinator.com/item?id=11662380 https://news.ycombinator.com/item?id=11662380 for how this works generally). I'm going to move this comment there as well because it includes more background info than you posted there.
- echelon 6y agoThanks, dang! :)
- deleted 6y ago[deleted]
- suyash 6y agowhat are the legal implications surrounding this now ?
- andykx 6y agoI don't think that there are any. Simply writing a program that outputs sounds that resemble someone's voice can't be illegal, right? You can use it in illegal ways, sure, but I don't think there are any laws concerning software like this.
- hamitron 6y agoSome of these people get paid for voiceover work, so this could get interesting
- suyash 6y agoyup, I would stay as far as possible from using this wit explicit permission, just putting it out there, the project has created legal risk IMO.
- toomuchtodo 6y agoAt least in the US, you can’t copyright your voice. Publicity rights is a can of worms depending on the jurisdiction. Tangentially related, if you have your voice print as a security mechanism at a financial institution (Vanguard), you should ask them to turn that off.
- taneq 6y agoThe Australian Taxation Office uses a voiceprinting system when you phone them, and I'm not sure there's a way to opt out.
- tzs 6y agoThere have been a couple cases or so in the US where singers have sued over their voices being imitated in commercials. As far as I know none of their copyright claims succeeded, but some still won on other grounds, such as the common law notion of appropriation of identity, or California's laws of publicity rights and federal laws on false endorsement. As I said, they lost on copyright claims but these cases involved their natural voice. If the voice was a made up voice, such as a character an animated character, I wouldn't immediately dismiss the idea that it might be copyrightable.
- bravoetch 6y agoWhat is the reason for them being almost all men?
- kabacha 6y agoMy guess would be that there are more interesting and recognizable voices by men than by women. Not everything is a CIS male's conspiracy you know.
- hipparchus 6y agoWhen was anyone implying this was a cis male's conspiracy ?
- sillysaurusx 6y agoIt's extremely hard to get women's voices to sound right in TTS, at least back when I was working on it. It was a striking difference, and I'm not sure why. e.g. I tried to do an Alyx version of https://www.youtube.com/watch?v=koU3L7WBz_s https://www.youtube.com/watch?v=koU3L7WBz_s but it came out sounding nothing like her.
- BrendanD 6y agoNeed Charles Bukowski model.
- toomuchtodo 6y agoAnd Samuel L Jackson.