Very good! Yes, that's basically how it works. I don't do any pitch-correction. But I do check the TTS output for lenght, and I re-generate if it doesn't matc

Very good! Yes, that's basically how it works. I don't do any pitch-correction. But I do check the TTS output for lenght, and I re-generate if it doesn't match my time contraints. I also have an arranger that tries to figure out when to play an utterance early (i.e. earlier than in the original) in order to make up for the translated version being longer. I try to make the translations match the speaker's character, as well as the context. So ideally, Alex (Sample 2) will still say "Salut" even in German (instead of translating that greeting, too). And I need to monitor for speaker changes. This is because I can't clone the voice unless I have a decent amount of sample data. If Elon just says "Yes", cloning the voice based on just that one syllable will make it sound like a robot. But I also can't just blindly grab any voice around it, since that might be somebody else's voice.