3 ms·

Given the tools available now to do speech replacement/ deepfakes / etc. I wonder is there anything open-source available for song-replacement. This is actuall

Given the tools available now to do speech replacement/ deepfakes / etc. I wonder is there anything open-source available for song-replacement. This is actually a problem I've seen on multiple (more innocuous) occasions: so-called "content-creator" youtubers casually mentioning that they had to throw away clips or rerecord sections during editing after realising there was copyrighted background noise. So I'd say there's definitely a market.

988747 5y ago
But if you do "song-replacement" then the video is now edited, and loses all credibility.
- lucideer 5y ago
  There's a reasonable argument that deepfakes are challenging our ability to rely on video evidence in general, but saying any editing at all removes credibility is pretty out there. Almost every video on the internet has been edited in some way.
  - pc86 5y ago
    Are there deepfakes out there that can withstand even a cursory technical interrogation? Most of them are extremely obvious once you've seen two or three.
    - nextlevelwizard 5y ago
      Depends what you mean by "technical". There are deep fakes that are good enough to fool some humans. There are deep fakes that are good enough to pass by some AI detection. Then there are some deep fakes that can not pass either. By definition this is unquatifiable problem since you won't know how many deep fakes you aren't detecting since you aren't detecting them.
    - lucideer 5y ago
      While it's blatantly obvious from the context and subject matter that they're fake, I did find quite a few of the Sassy Justice[0] series' examples to be quite convincing from a technical standpoint (I imagine they could have been undetectable given more subtle context & subject matter) [0] https://www.youtube.com/watch?v=9WfZuNceFDM https://www.youtube.com/watch?v=9WfZuNceFDM
- hirundo 5y ago
  So post the video with the copyright-material-subtracted audio, plus a link to the unedited audio.
- nextlevelwizard 5y ago
  Stupid question: How do you know that the video isn't "edited"? It clearly has been edited to add the subtitles and the watermark to the top left corner and it has fade to black and then fade in their logo and donation link at the end.
Hamuko 5y ago
It'd probably be better to do a vocal boost to the max and try to silence the music part as much as you can. Although I don't really know how often it's going to be necessary. Here I am watching this police officer blast some garbled mess on a YouTube video.
- lucideer 5y ago
  A straight vocal boost would change the audio profile of the overall scene pretty significantly, so I'm thinking some tool that has less impact would be desirable. > I don't really know how often it's going to be necessary. Here I am watching this police officer blast some garbled mess I don't know how it'd fare in this instance but continuous improvements to the Shazam-esque algorithms used by copyright-flagging bots might make this less and less likely to go undetected.
eqtn 5y ago
There is "Mute song only(beta)" in YouTube which says "Remove the claimed song only, keeping the rest of the sound. This option usually takes longer and might not work if the song is hard to remove"
- Hamuko 5y ago
  I've tried it on a short clip that's under a minute long and it never actually processed the file when I tried. The beta flag is definitely warranted and you really don't want to rely on it.

988747 5y ago

But if you do "song-replacement" then the video is now edited, and loses all credibility.

lucideer 5y ago
There's a reasonable argument that deepfakes are challenging our ability to rely on video evidence in general, but saying any editing at all removes credibility is pretty out there. Almost every video on the internet has been edited in some way.
- pc86 5y ago
  Are there deepfakes out there that can withstand even a cursory technical interrogation? Most of them are extremely obvious once you've seen two or three.
  - nextlevelwizard 5y ago
    Depends what you mean by "technical". There are deep fakes that are good enough to fool some humans. There are deep fakes that are good enough to pass by some AI detection. Then there are some deep fakes that can not pass either. By definition this is unquatifiable problem since you won't know how many deep fakes you aren't detecting since you aren't detecting them.
  - lucideer 5y ago
    While it's blatantly obvious from the context and subject matter that they're fake, I did find quite a few of the Sassy Justice[0] series' examples to be quite convincing from a technical standpoint (I imagine they could have been undetectable given more subtle context & subject matter) [0] https://www.youtube.com/watch?v=9WfZuNceFDM https://www.youtube.com/watch?v=9WfZuNceFDM
hirundo 5y ago
So post the video with the copyright-material-subtracted audio, plus a link to the unedited audio.
nextlevelwizard 5y ago
Stupid question: How do you know that the video isn't "edited"? It clearly has been edited to add the subtitles and the watermark to the top left corner and it has fade to black and then fade in their logo and donation link at the end.

Hamuko 5y ago

It'd probably be better to do a vocal boost to the max and try to silence the music part as much as you can. Although I don't really know how often it's going to be necessary. Here I am watching this police officer blast some garbled mess on a YouTube video.

lucideer 5y ago
A straight vocal boost would change the audio profile of the overall scene pretty significantly, so I'm thinking some tool that has less impact would be desirable. > I don't really know how often it's going to be necessary. Here I am watching this police officer blast some garbled mess I don't know how it'd fare in this instance but continuous improvements to the Shazam-esque algorithms used by copyright-flagging bots might make this less and less likely to go undetected.

eqtn 5y ago

There is "Mute song only(beta)" in YouTube which says "Remove the claimed song only, keeping the rest of the sound. This option usually takes longer and might not work if the song is hard to remove"

Hamuko 5y ago
I've tried it on a short clip that's under a minute long and it never actually processed the file when I tried. The beta flag is definitely warranted and you really don't want to rely on it.