5 ms·

If you want to try out the voice cloning yourself you can do that an this Hugging Face demo: https://huggingface.co/spaces/Qwen/Qwen3-TTS https://huggingface.co

by simonw 10mo ago

If you want to try out the voice cloning yourself you can do that an this Hugging Face demo: https://huggingface.co/spaces/Qwen/Qwen3-TTS https://huggingface.co/spaces/Qwen/Qwen3-TTS - switch to the "Voice Clone" tab, paste in some example text and use the microphone option to record yourself reading that text - then paste in other text and have it generate a version of that read using your voice. I shared a recording of audio I generated with that here: https://simonwillison.net/2026/Jan/22/qwen3-tts/ https://simonwillison.net/2026/Jan/22/qwen3-tts/

javier123454321 10mo ago
This is terrifying. With this and z-image-turbo, we've crossed a chasm. And a very deep one. We are currently protected by screens, we can, and should assume everything behind a screen is fake unless rigorously (and systematically, i.e. cryptographically) proven otherwise. We're sleepwalking into this, not enough people know about it.
- rdtsc 10mo ago
  That was my thought too. You’d have “loved ones” calling with their faces and voices asking for money in some emergency. But you’d also have plausible deniability as anything digital can be brushed off as “that’s not evidence, it could be AI generated”.
  - neevans 10mo ago
    this was already possible with chatterbox for a long while.
    - freedomben 10mo ago
      Yep, this has been the reality now for years. Scammers have already had access to it. I remember an article years ago about a grandma who wired her life savings to a scammer who claimed to have her granddaughter held hostage in a foreign country. Turns out they just cloned her voice from Facebook data and knew her schedule so timed it while she would be unreachable by phone.
    - DANmode 10mo ago
      or anyone who refuses to use hearing aids.
  - rpdillon 10mo ago
    Only if you focus on the form instead of the content. For a long time my family has had secret words and phrases we use to identify ourselves to each other over secure, but unauthenticated, channels (i.e. the channel is encrypted, but the source is unknown). The military has had to deal with this for some time, and developed various form of IFF that allies could use to identify themselves. E.g. for returning aircraft, a sequence of wing movements that identified you as friend. I think for a small group (in this case, loved ones), this could be one mitigation of that risk. My parents did this with me as a kid, ostensibly as a defense against some other adult saying "My mom sent me to pick you up...". I never did hear of that happening, though.
    - nineteen999 10mo ago
      That sounds way too complicated. I get around that by just not having any family any more.
  - aprilthird2021 10mo ago
    > as anything digital can be brushed off as “that’s not evidence, it could be AI generated”. This won't change anything about Western style courts which have always required an unbroken chain of custody of evidence for evidence to be admissable in court
    - cwillu 10mo ago
      Court account for a vanishingly small proportion of most people's lives.
      - aprilthird2021 10mo ago
        So does the presentation of evidence...
  - plagiarist 10mo ago
    For now you could ask them to turn away from the camera while keeping their eyes open. If they are a Z-Image they will instantly snap their head to face you.
    - muggermuch 10mo ago
      This scenario is oddly terrifying.
- echelon 10mo ago
  We're going to be okay. There are far more good and interesting use cases for this technology. Games will let users clone their voices and create virtual avatars and heroes. People will have access to creative tools that let them make movies and shows with their likeness. People that couldn't sing will make music. Nothing was more scary than the invention of the nuclear weapon. And we're all still here. Life will go on. And there will be incredible benefits that come out of this.
  - supern0va 10mo ago
    We'll be okay eventually, when society adapts to this and becomes fully aware of the capabilities and the use cases for abuse. But, that may take some time. The parent is right to be concerned about the interim, at the very least. That said, I am likewise looking forward to the cool things to come out of this.
  - DANmode 10mo ago
    > People that couldn't sing will make music. I was with you, until But, yeah. Life will go on.
    - echelon 10mo ago
      There are plenty of electronic artists who can't sing. Right now they have to hire someone else to do the singing for them, but I'd wager a lot of them would like to own their music end-to-end. I would. I'm a filmmaker. I've done it photons-on-glass production for fifteen years. Meisner trained, have performed every role from cast to crew. I'm elated that these tools are going to enable me to do more with a smaller budget. To have more autonomy and creative control.
      - javier123454321 10mo ago
        Yes, the flipside of this is that we're eroding the last bit of ability for people to make a living through their art. We are capturing the market for people to live off of making illustrations, to making background music, jingles, promotional videos, photographs, graphic design, and funnelling those earnings to NVIDIA. The question I keep asking is whether we care to value as a society for people to make a living through their art. I think there is a reason to care. It's not so much of an issue with art for art's sake aided by AI. It's an issue with artistic work becoming unviable work.
- oceanplexian 10mo ago
  > This is terrifying. Far more terrifying is Big Tech having access to a closed version of the same models, in the hands of powerful people with a history of unethical behavior (i.e. Zuckerberg's "Dumb Fucks" comments). In fact it's a miracle and a bit ironic that the Chinese would be the ones to release a plethora of capable open source models, instead of the scraps like we've seen from Google, Meta, OpenAI, etc.
  - javier123454321 10mo ago
    I do strongly agree. Though the societal impact is only mitigated by open models, not curtailed at all.
  - mrandish 10mo ago
    > Far more terrifying is Big Tech having access to a closed version of the same model Agreed. The only thing worse than everyone having access to this tech is only governments, mega corps and highly-motivated bad actors having access. They've had it a while and there's no putting the genii back in the bottle. The best thing the rest of us can do is use it widely so everyone can adapt to this being the new normal.
    - apitman 10mo ago
      I know genii is the plural of genie, but for a second I thought it was a typo of genai and I kind of like that better.
  - vonneumannstan 10mo ago
    >Far more terrifying is Big Tech having access to a closed version of the same models, in the hands of powerful people with a history of unethical behavior (i.e. Zuckerberg's "Dumb Fucks" comments). Lol what exactly do you think Zuck would do with your voice, drain your bank account??
    - liamN 10mo ago
      More likely sell your family ads while using your voice.
- fridder 10mo ago
  Admittedly I have not dove into it much but, I wonder if we might finally have a usecase for NFTs and web3? We need some sort of way to denote items are persion generated not AI. Would certainly be easier than trying to determine if something is AI generated
  - grumbel 10mo ago
    That's the idea behind C2PA[1], your camera and the tools put a signature on the media to prove its provenance. That doesn't make manipulation impossible (e.g. you could photograph an AI image of a screen), but it does give you a trail of where a photo came from and thus an easier way to filter it or lookup the original. [1] https://c2pa.org/ https://c2pa.org/
  - simonw 10mo ago
    How would NFTs/web3 help differentiate between something created by a human and something that a human created with AI and then tagged with their signature using those tools?
    - _kb 10mo ago
      In a live conversation context you can mention the term NFTs/web3 and if the far end is human they'll wince a little.
      - disillusioned 10mo ago
        This made me laugh far too hard for far too long.
- u8080 10mo ago
  https://www.youtube.com/watch?v=diboERFAjkE https://www.youtube.com/watch?v=diboERFAjkE pretty much this
  - javier123454321 10mo ago
    Oh wow. Thank you for this. Amazing, terrifying, spot on, all of it.
    - arcanemachiner 10mo ago
      I knew what it would be before I even opened it. The crazy thing is that video is like 3 years old.
  - harshreality 10mo ago
    That's a reupload of Cybergem's video. https://www.youtube.com/watch?v=-gGLvg0n-uY https://www.youtube.com/watch?v=-gGLvg0n-uY
- razster 10mo ago
  I'd be a bit more worried with Z-Image Edit/Base is release. Flux.2 Klein is our and its on par with Zit, and with some fine tuning can just about hit Flux.2. Adding on top of that is Qwen Image Edit 2511 for additional refinement. Anything is possible. Those folks at r/StableDiffusion and falling over the possible release of Z-Image-Omni-Base, a hold me over until actual base is out. I've heard its equal to Flux.2. Crazy time.
- TacticalCoder 10mo ago
  > With this and z-image-turbo, we've crossed a chasm. And most of all: they're both local models. The cat is out of the box and it's never going back in. There's no censoring of this. No company that can pull the plug. Anyone with a semi-modern GPU can use these models.
pseudosavant 10mo ago
Remarkable tech that is now accessible to almost anyone. My cloned voice sounded exactly like me. The uses for this will be from good to bad and everywhere in-between. A deceased grandmother reading "Good Night Moon" to grandkids, scamming people, the ability to create podcasts with your own voices from just prompts.
- _kb 10mo ago
  It's a good thing governments (https://www.ato.gov.au/online-services/voice-authentication https://www.ato.gov.au/online-services/voice-authentication) and banks (https://www.anz.com.au/security/how-we-protect-you/voice-id/ https://www.anz.com.au/security/how-we-protect-you/voice-id/) haven't gone all in on using voice as an authentication mechanism.
magicalhippo 10mo ago
The HF demo space was overloaded, but I got the demo working locally easily enough. The voice cloning of the 1.7B model captures the tone of the speaker very well, but I found it failed at reproducing the variation in intonation, so it sounds like a monotonous reading of a boring text. I presume this is due to using the base model, and not the one tuned for more expressiveness. edit: Or more likely, the demo not exposing the expressiveness controls. The 1.7B model was much better at ignoring slight background noise in the reference audio compared to the 0.6B model though. The 0.6B would inject some of that into the generated audio, whereas the 1.7B model would not. Also, without FlashAttention it was dog slow on my 5090, running at 0.3X realtime with just 30% GPU usage. Though I guess that's to be expected. No significant difference in generation speed between the two models. Overall though, I'm quite impressed. I haven't checked out all the recent TTS models, but a fair number, and this one is certainly one of the better ones in terms of voice cloning quality I've heard.
- thedangler 10mo ago
  How did you do this locally? Tools? Language?
  - magicalhippo 10mo ago
    I just followed the Quickstart[1] in the GitHub repo, refreshingly straight forward. Using the pip package worked fine, as did installing the editable version using the git repository. Just install the CUDA version of PyTorch[2] first. The HF demo is very similar to the GitHub demo, so easy to try out. pip install torch torchvision --index-url https://download.pytorch.org/whl/cu128 pip install qwen3-tts qwen-tts-demo Qwen/Qwen3-TTS-12Hz-1.7B-Base --no-flash-attn --ip 127.0.0.1 --port 8000 That's for CUDA 12.8, change PyTorch install accordingly. Skipped FlashAttention since I'm on Windows and I haven't gotten FlashAttention 2 to work there yet (I found some precompiled FA3 files[3] but Qwen3-TTS isn't FA3 compatible yet). [1]: https://github.com/QwenLM/Qwen3-TTS?tab=readme-ov-file#quickstart https://github.com/QwenLM/Qwen3-TTS?tab=readme-ov-file#quick... [2]: https://pytorch.org/get-started/locally/ https://pytorch.org/get-started/locally/ [3]: https://windreamer.github.io/flash-attention3-wheels/ https://windreamer.github.io/flash-attention3-wheels/
mohsen1 10mo ago
> The requested GPU duration (180s) is larger than the maximum allowed What am I doing wrong?
- gregsadetsky 10mo ago
  you need to login
kingstnap 10mo ago
It was fun to try out. I wonder if at some point if I have a few minutes of me talking I could make myself read an entire book to myself.
KolmogorovComp 10mo ago
Hello, the recording you posted does not tell much about the cloning capability without an example from your real voice.
- simonw 10mo ago
  Given how easy voice cloning is with this thing I chickened out of sharing the training audio I recorded! That's not really rational considering the internet is full of examples of my voice that anyone could use though. Here's a recent podcast clip: https://www.youtube.com/watch?v=lVDhQMiAbR8&t=3006s https://www.youtube.com/watch?v=lVDhQMiAbR8&t=3006s
  - KolmogorovComp 10mo ago
    Thanks, so it’s in the [pretty close but still distinguishable] range.
    - genewitch 10mo ago
      it depends on the medium. A flac will be distinguishable (for now); but put it out over low bandwidth media and you get https://youtube.com/shorts/dpScfg3how8 https://youtube.com/shorts/dpScfg3how8 which, https://www.youtube.com/shorts/zi7BVqVzRx4 https://www.youtube.com/shorts/zi7BVqVzRx4 is real good and close to what that podcaster's voice sounded like when i made that clone! i have several other examples from before my repeater ID voice clone. Newer voice models will have to wait till i recover my NAS tomorrow! this is the newest one i have access to: Dick Powell voice clone off his Richard Diamond Persona: https://soundcloud.com/djoutcold/dick-powell-voice-clone-test-2 https://soundcloud.com/djoutcold/dick-powell-voice-clone-tes... i was one-shotting voices years ago that were timbre/tonally identical to the reference voice; however the issue i had was inflection and subtlety. I find that female voices are much easier to clone, or at least it fools my brain into thinking so. this model, if the results weren't too cherry picked, will be huge improvement!
cristoperb 10mo ago
I cloned my voice and had it generate audio for a paragraph from something I wrote. It definitely kind of sounds like me, but I like it much better than listening to my real voice. Some kind of uncanny peak.
- viraptor 10mo ago
  They weirdly makes it a canny peak though :)
- bsenftner 10mo ago
  You do realize that you don't hear your real voice normally, an individual has to record their voice to hear how others hear their voice. What you hear when you speak includes your skull resonating, which other's do not hear.
parentheses 10mo ago
I got some errors trying to run this on my MBP. Claude was able to one-shot a fix. ``` Loaded speech tokenizer from ~/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-1.7B-VoiceDesign/snapshots/0e711a1c0aa5aad30654426 e0d11f67716c1211e/speech_tokenizer Fetching 11 files: 0%| | 0/11 [00:00<?, ?it/s]Fetching 11 files: 100%|| 11/11 [00:00<00:00, 125033.45it/s] The tokenizer you are loading from '!/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-1.7B-VoiceDesign/snapshots/0e711a1c0aa5aad30654426e0d11f67716c1211e' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instr.... This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue. ```
itsTyrion 10mo ago
well that isnt concerning at all

by simonw 10mo ago

javier123454321 10mo ago

This is terrifying. With this and z-image-turbo, we've crossed a chasm. And a very deep one. We are currently protected by screens, we can, and should assume everything behind a screen is fake unless rigorously (and systematically, i.e. cryptographically) proven otherwise. We're sleepwalking into this, not enough people know about it.

rdtsc 10mo ago
That was my thought too. You’d have “loved ones” calling with their faces and voices asking for money in some emergency. But you’d also have plausible deniability as anything digital can be brushed off as “that’s not evidence, it could be AI generated”.
- neevans 10mo ago
  this was already possible with chatterbox for a long while.
  - freedomben 10mo ago
    Yep, this has been the reality now for years. Scammers have already had access to it. I remember an article years ago about a grandma who wired her life savings to a scammer who claimed to have her granddaughter held hostage in a foreign country. Turns out they just cloned her voice from Facebook data and knew her schedule so timed it while she would be unreachable by phone.
  - DANmode 10mo ago
    or anyone who refuses to use hearing aids.
- rpdillon 10mo ago
  Only if you focus on the form instead of the content. For a long time my family has had secret words and phrases we use to identify ourselves to each other over secure, but unauthenticated, channels (i.e. the channel is encrypted, but the source is unknown). The military has had to deal with this for some time, and developed various form of IFF that allies could use to identify themselves. E.g. for returning aircraft, a sequence of wing movements that identified you as friend. I think for a small group (in this case, loved ones), this could be one mitigation of that risk. My parents did this with me as a kid, ostensibly as a defense against some other adult saying "My mom sent me to pick you up...". I never did hear of that happening, though.
  - nineteen999 10mo ago
    That sounds way too complicated. I get around that by just not having any family any more.
- aprilthird2021 10mo ago
  > as anything digital can be brushed off as “that’s not evidence, it could be AI generated”. This won't change anything about Western style courts which have always required an unbroken chain of custody of evidence for evidence to be admissable in court
  - cwillu 10mo ago
    Court account for a vanishingly small proportion of most people's lives.
    - aprilthird2021 10mo ago
      So does the presentation of evidence...
- plagiarist 10mo ago
  For now you could ask them to turn away from the camera while keeping their eyes open. If they are a Z-Image they will instantly snap their head to face you.
  - muggermuch 10mo ago
    This scenario is oddly terrifying.
echelon 10mo ago
We're going to be okay. There are far more good and interesting use cases for this technology. Games will let users clone their voices and create virtual avatars and heroes. People will have access to creative tools that let them make movies and shows with their likeness. People that couldn't sing will make music. Nothing was more scary than the invention of the nuclear weapon. And we're all still here. Life will go on. And there will be incredible benefits that come out of this.
- supern0va 10mo ago
  We'll be okay eventually, when society adapts to this and becomes fully aware of the capabilities and the use cases for abuse. But, that may take some time. The parent is right to be concerned about the interim, at the very least. That said, I am likewise looking forward to the cool things to come out of this.
- DANmode 10mo ago
  > People that couldn't sing will make music. I was with you, until But, yeah. Life will go on.
  - echelon 10mo ago
    There are plenty of electronic artists who can't sing. Right now they have to hire someone else to do the singing for them, but I'd wager a lot of them would like to own their music end-to-end. I would. I'm a filmmaker. I've done it photons-on-glass production for fifteen years. Meisner trained, have performed every role from cast to crew. I'm elated that these tools are going to enable me to do more with a smaller budget. To have more autonomy and creative control.
    - javier123454321 10mo ago
      Yes, the flipside of this is that we're eroding the last bit of ability for people to make a living through their art. We are capturing the market for people to live off of making illustrations, to making background music, jingles, promotional videos, photographs, graphic design, and funnelling those earnings to NVIDIA. The question I keep asking is whether we care to value as a society for people to make a living through their art. I think there is a reason to care. It's not so much of an issue with art for art's sake aided by AI. It's an issue with artistic work becoming unviable work.
oceanplexian 10mo ago
> This is terrifying. Far more terrifying is Big Tech having access to a closed version of the same models, in the hands of powerful people with a history of unethical behavior (i.e. Zuckerberg's "Dumb Fucks" comments). In fact it's a miracle and a bit ironic that the Chinese would be the ones to release a plethora of capable open source models, instead of the scraps like we've seen from Google, Meta, OpenAI, etc.
- javier123454321 10mo ago
  I do strongly agree. Though the societal impact is only mitigated by open models, not curtailed at all.
- mrandish 10mo ago
  > Far more terrifying is Big Tech having access to a closed version of the same model Agreed. The only thing worse than everyone having access to this tech is only governments, mega corps and highly-motivated bad actors having access. They've had it a while and there's no putting the genii back in the bottle. The best thing the rest of us can do is use it widely so everyone can adapt to this being the new normal.
  - apitman 10mo ago
    I know genii is the plural of genie, but for a second I thought it was a typo of genai and I kind of like that better.
- vonneumannstan 10mo ago
  >Far more terrifying is Big Tech having access to a closed version of the same models, in the hands of powerful people with a history of unethical behavior (i.e. Zuckerberg's "Dumb Fucks" comments). Lol what exactly do you think Zuck would do with your voice, drain your bank account??
  - liamN 10mo ago
    More likely sell your family ads while using your voice.
fridder 10mo ago
Admittedly I have not dove into it much but, I wonder if we might finally have a usecase for NFTs and web3? We need some sort of way to denote items are persion generated not AI. Would certainly be easier than trying to determine if something is AI generated
- grumbel 10mo ago
  That's the idea behind C2PA[1], your camera and the tools put a signature on the media to prove its provenance. That doesn't make manipulation impossible (e.g. you could photograph an AI image of a screen), but it does give you a trail of where a photo came from and thus an easier way to filter it or lookup the original. [1] https://c2pa.org/ https://c2pa.org/
- simonw 10mo ago
  How would NFTs/web3 help differentiate between something created by a human and something that a human created with AI and then tagged with their signature using those tools?
  - _kb 10mo ago
    In a live conversation context you can mention the term NFTs/web3 and if the far end is human they'll wince a little.
    - disillusioned 10mo ago
      This made me laugh far too hard for far too long.
u8080 10mo ago
https://www.youtube.com/watch?v=diboERFAjkE https://www.youtube.com/watch?v=diboERFAjkE pretty much this
- javier123454321 10mo ago
  Oh wow. Thank you for this. Amazing, terrifying, spot on, all of it.
  - arcanemachiner 10mo ago
    I knew what it would be before I even opened it. The crazy thing is that video is like 3 years old.
- harshreality 10mo ago
  That's a reupload of Cybergem's video. https://www.youtube.com/watch?v=-gGLvg0n-uY https://www.youtube.com/watch?v=-gGLvg0n-uY
razster 10mo ago
I'd be a bit more worried with Z-Image Edit/Base is release. Flux.2 Klein is our and its on par with Zit, and with some fine tuning can just about hit Flux.2. Adding on top of that is Qwen Image Edit 2511 for additional refinement. Anything is possible. Those folks at r/StableDiffusion and falling over the possible release of Z-Image-Omni-Base, a hold me over until actual base is out. I've heard its equal to Flux.2. Crazy time.
TacticalCoder 10mo ago
> With this and z-image-turbo, we've crossed a chasm. And most of all: they're both local models. The cat is out of the box and it's never going back in. There's no censoring of this. No company that can pull the plug. Anyone with a semi-modern GPU can use these models.

pseudosavant 10mo ago

Remarkable tech that is now accessible to almost anyone. My cloned voice sounded exactly like me. The uses for this will be from good to bad and everywhere in-between. A deceased grandmother reading "Good Night Moon" to grandkids, scamming people, the ability to create podcasts with your own voices from just prompts.

_kb 10mo ago
It's a good thing governments (https://www.ato.gov.au/online-services/voice-authentication https://www.ato.gov.au/online-services/voice-authentication) and banks (https://www.anz.com.au/security/how-we-protect-you/voice-id/ https://www.anz.com.au/security/how-we-protect-you/voice-id/) haven't gone all in on using voice as an authentication mechanism.

magicalhippo 10mo ago

The HF demo space was overloaded, but I got the demo working locally easily enough. The voice cloning of the 1.7B model captures the tone of the speaker very well, but I found it failed at reproducing the variation in intonation, so it sounds like a monotonous reading of a boring text. I presume this is due to using the base model, and not the one tuned for more expressiveness. edit: Or more likely, the demo not exposing the expressiveness controls. The 1.7B model was much better at ignoring slight background noise in the reference audio compared to the 0.6B model though. The 0.6B would inject some of that into the generated audio, whereas the 1.7B model would not. Also, without FlashAttention it was dog slow on my 5090, running at 0.3X realtime with just 30% GPU usage. Though I guess that's to be expected. No significant difference in generation speed between the two models. Overall though, I'm quite impressed. I haven't checked out all the recent TTS models, but a fair number, and this one is certainly one of the better ones in terms of voice cloning quality I've heard.

thedangler 10mo ago
How did you do this locally? Tools? Language?
- magicalhippo 10mo ago
  I just followed the Quickstart[1] in the GitHub repo, refreshingly straight forward. Using the pip package worked fine, as did installing the editable version using the git repository. Just install the CUDA version of PyTorch[2] first. The HF demo is very similar to the GitHub demo, so easy to try out. pip install torch torchvision --index-url https://download.pytorch.org/whl/cu128 pip install qwen3-tts qwen-tts-demo Qwen/Qwen3-TTS-12Hz-1.7B-Base --no-flash-attn --ip 127.0.0.1 --port 8000 That's for CUDA 12.8, change PyTorch install accordingly. Skipped FlashAttention since I'm on Windows and I haven't gotten FlashAttention 2 to work there yet (I found some precompiled FA3 files[3] but Qwen3-TTS isn't FA3 compatible yet). [1]: https://github.com/QwenLM/Qwen3-TTS?tab=readme-ov-file#quickstart https://github.com/QwenLM/Qwen3-TTS?tab=readme-ov-file#quick... [2]: https://pytorch.org/get-started/locally/ https://pytorch.org/get-started/locally/ [3]: https://windreamer.github.io/flash-attention3-wheels/ https://windreamer.github.io/flash-attention3-wheels/

mohsen1 10mo ago

> The requested GPU duration (180s) is larger than the maximum allowed What am I doing wrong?

gregsadetsky 10mo ago
you need to login

kingstnap 10mo ago

It was fun to try out. I wonder if at some point if I have a few minutes of me talking I could make myself read an entire book to myself.

KolmogorovComp 10mo ago

Hello, the recording you posted does not tell much about the cloning capability without an example from your real voice.

simonw 10mo ago
Given how easy voice cloning is with this thing I chickened out of sharing the training audio I recorded! That's not really rational considering the internet is full of examples of my voice that anyone could use though. Here's a recent podcast clip: https://www.youtube.com/watch?v=lVDhQMiAbR8&t=3006s https://www.youtube.com/watch?v=lVDhQMiAbR8&t=3006s
- KolmogorovComp 10mo ago
  Thanks, so it’s in the [pretty close but still distinguishable] range.
  - genewitch 10mo ago
    it depends on the medium. A flac will be distinguishable (for now); but put it out over low bandwidth media and you get https://youtube.com/shorts/dpScfg3how8 https://youtube.com/shorts/dpScfg3how8 which, https://www.youtube.com/shorts/zi7BVqVzRx4 https://www.youtube.com/shorts/zi7BVqVzRx4 is real good and close to what that podcaster's voice sounded like when i made that clone! i have several other examples from before my repeater ID voice clone. Newer voice models will have to wait till i recover my NAS tomorrow! this is the newest one i have access to: Dick Powell voice clone off his Richard Diamond Persona: https://soundcloud.com/djoutcold/dick-powell-voice-clone-test-2 https://soundcloud.com/djoutcold/dick-powell-voice-clone-tes... i was one-shotting voices years ago that were timbre/tonally identical to the reference voice; however the issue i had was inflection and subtlety. I find that female voices are much easier to clone, or at least it fools my brain into thinking so. this model, if the results weren't too cherry picked, will be huge improvement!

cristoperb 10mo ago

I cloned my voice and had it generate audio for a paragraph from something I wrote. It definitely kind of sounds like me, but I like it much better than listening to my real voice. Some kind of uncanny peak.

viraptor 10mo ago
They weirdly makes it a canny peak though :)
bsenftner 10mo ago
You do realize that you don't hear your real voice normally, an individual has to record their voice to hear how others hear their voice. What you hear when you speak includes your skull resonating, which other's do not hear.

parentheses 10mo ago

I got some errors trying to run this on my MBP. Claude was able to one-shot a fix. ``` Loaded speech tokenizer from ~/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-1.7B-VoiceDesign/snapshots/0e711a1c0aa5aad30654426 e0d11f67716c1211e/speech_tokenizer Fetching 11 files: 0%| | 0/11 [00:00<?, ?it/s]Fetching 11 files: 100%|| 11/11 [00:00<00:00, 125033.45it/s] The tokenizer you are loading from '!/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-1.7B-VoiceDesign/snapshots/0e711a1c0aa5aad30654426e0d11f67716c1211e' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instr.... This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue. ```

itsTyrion 10mo ago

well that isnt concerning at all