4 ms·

How do you assert that the cloned voice has been truly permitted by the voice owner? I've had my voice cloned without my consent by other people using Descript

How do you assert that the cloned voice has been truly permitted by the voice owner? I've had my voice cloned without my consent by other people using Descript and Eleven Labs. What is your process for verifying consent?

1xdevloper 4y ago
It's mentioned in the second demo video that they have a strict process to prevent cases like yours. I think Descript started asking for identity verification after its service was abused. This one probably has a similar process too.
- deleted 4y ago
  [deleted]
- dkdbejwi383 4y ago
  I think the previous comment wants to know what the "strict process" is exactly.
- yellow_lead 4y ago
  But they don't say what it is
- whywhywouldyou 4y ago
  Right, and I'm sure their "strict process" is something like "we take it down after you notify us and provide proof that the voice is yours".
ros86 4y ago
When I tried this service previously, you had to read (out loud) something saying that you were giving consent.
- Aachen 4y ago
  I'd be curious what the false positive rate on that is. Can you clone anyone's by collecting a set of ten voices with unique timbre reading the required statement plus pitch control to get close enough? A hundred? Or can you trick the neural net by giving it something that sounds like white noise to humans until the NN triggers in the right way and goes "ok yep that's a match, you're authorised now"? Probably not something we'll get to hear as part of the PR pitch. Or is the consent statement the thing that will be cloned and is there no separate training audio? Then it might actually work and you'll just have to get close enough that the human you're trying to fool can't distinguish anymore (defeating the need for this tech in the first place, at least in targeted rather than automated cases).
  - ros86 4y ago
    Yeah, good point - don't know. When I tried I actually did get a (personal?) email saying that it didn't match closely enough. After uploading another sample (based on a different text) it went through. I like your idea of just training on the consent text! That wasn't the case when I tried it as you needed around 3h (optimally) of training data.
  - cortesoft 4y ago
    If someone has the capability to trick the service like that, they likely have the capability to recreate the functionality themselves.
    - Aachen 4y ago
      With a couple soundalike voices and changing the pitch in Audacity? That's a far, far cry from doing cutting edge neural networks that clone voices with samples of less than half a minute. If you mean the white noise, I meant that as a brute force attack because, to do it more targeted (to know what it'll accept as seeming like your target voice), you'd likely need their exact model rather than doing your own.
- deleted 4y ago
  [deleted]
- barking_biscuit 4y ago
  Just use another voice cloning service to do that.
- vishalchandra 4y ago
  True
mikecoles 4y ago
TIL, the Booth Junkie is on HN. Love your work, sir.
- delgaudm 4y ago
  Thanks my friend!

1xdevloper 4y ago

It's mentioned in the second demo video that they have a strict process to prevent cases like yours. I think Descript started asking for identity verification after its service was abused. This one probably has a similar process too.

deleted 4y ago
[deleted]
dkdbejwi383 4y ago
I think the previous comment wants to know what the "strict process" is exactly.
yellow_lead 4y ago
But they don't say what it is
whywhywouldyou 4y ago
Right, and I'm sure their "strict process" is something like "we take it down after you notify us and provide proof that the voice is yours".

ros86 4y ago

When I tried this service previously, you had to read (out loud) something saying that you were giving consent.

Aachen 4y ago
I'd be curious what the false positive rate on that is. Can you clone anyone's by collecting a set of ten voices with unique timbre reading the required statement plus pitch control to get close enough? A hundred? Or can you trick the neural net by giving it something that sounds like white noise to humans until the NN triggers in the right way and goes "ok yep that's a match, you're authorised now"? Probably not something we'll get to hear as part of the PR pitch. Or is the consent statement the thing that will be cloned and is there no separate training audio? Then it might actually work and you'll just have to get close enough that the human you're trying to fool can't distinguish anymore (defeating the need for this tech in the first place, at least in targeted rather than automated cases).
- ros86 4y ago
  Yeah, good point - don't know. When I tried I actually did get a (personal?) email saying that it didn't match closely enough. After uploading another sample (based on a different text) it went through. I like your idea of just training on the consent text! That wasn't the case when I tried it as you needed around 3h (optimally) of training data.
- cortesoft 4y ago
  If someone has the capability to trick the service like that, they likely have the capability to recreate the functionality themselves.
  - Aachen 4y ago
    With a couple soundalike voices and changing the pitch in Audacity? That's a far, far cry from doing cutting edge neural networks that clone voices with samples of less than half a minute. If you mean the white noise, I meant that as a brute force attack because, to do it more targeted (to know what it'll accept as seeming like your target voice), you'd likely need their exact model rather than doing your own.
deleted 4y ago
[deleted]
barking_biscuit 4y ago
Just use another voice cloning service to do that.
vishalchandra 4y ago
True

mikecoles 4y ago

TIL, the Booth Junkie is on HN. Love your work, sir.

delgaudm 4y ago
Thanks my friend!