4 ms·

You might be interested in Meta’s Demucs, which can split a song into drums, bass, vocals and other stems. It’s really very impressive, I can’t quite believe su

You might be interested in Meta’s Demucs, which can split a song into drums, bass, vocals and other stems. It’s really very impressive, I can’t quite believe such results are possible! https://github.com/facebookresearch/demucs https://github.com/facebookresearch/demucs You can try it out at https://huggingface.co/spaces/akhaliq/demucs https://huggingface.co/spaces/akhaliq/demucs if you don’t want to install it. If you google “source separation” there are a bunch of hosted services which mostly use either Demucs or Spleeter (which was an earlier, good but not as good, system from Deezer)

themitigating 4y ago
Songs are also composed of each instrument on a single audio track and they are sometimes distributed
- tomduncalf 4y ago
  Oh yeah of course, but in my experience it’s quite rare for these multi-tracks to end up online. Demucs can in many cases extract an acappella which would be good enough to make a remix with (of course using ML trickery, so it’s not going to be the actual real acappella and might have some leakage from other sounds in the track etc.)
ROTMetro 4y ago
These tools are awesome, I have iZotope RX which also does a version of this, but when I'm in the music flow grabbing something off of youtube vs firing up another piece of software can be more conducive creatively for me.
- tomduncalf 4y ago
  Yeah makes sense! I’m sure we will start to see this integrated into the next generations of a lot of music making software with it being open source. FWIW Demucs sounds a lot better than the RX separation (which I think uses Spleeter, could be wrong) to my ears - it doesn’t have any of that mushy “low bitrate” kind of sound, it’s much crisper
  - ROTMetro 4y ago
    I wonder how hard it would be to write a Max4Live device that wraps this? That would be awesome, have the original track in my project for reference, and have a Max4Live device generate isolated stems of the different parts.
    - tomduncalf 4y ago
      I thought about the exact same thing when I first saw Spleeter and it turned out someone had already done it: https://github.com/diracdeltas/spleeter4max https://github.com/diracdeltas/spleeter4max Looks like the meat of this is using a JS script to invoke Spleeter using execSync so it might be quite simple to adapt to Demucs, maybe I’ll give it a go!

themitigating 4y ago

Songs are also composed of each instrument on a single audio track and they are sometimes distributed

tomduncalf 4y ago
Oh yeah of course, but in my experience it’s quite rare for these multi-tracks to end up online. Demucs can in many cases extract an acappella which would be good enough to make a remix with (of course using ML trickery, so it’s not going to be the actual real acappella and might have some leakage from other sounds in the track etc.)

ROTMetro 4y ago

These tools are awesome, I have iZotope RX which also does a version of this, but when I'm in the music flow grabbing something off of youtube vs firing up another piece of software can be more conducive creatively for me.

tomduncalf 4y ago
Yeah makes sense! I’m sure we will start to see this integrated into the next generations of a lot of music making software with it being open source. FWIW Demucs sounds a lot better than the RX separation (which I think uses Spleeter, could be wrong) to my ears - it doesn’t have any of that mushy “low bitrate” kind of sound, it’s much crisper
- ROTMetro 4y ago
  I wonder how hard it would be to write a Max4Live device that wraps this? That would be awesome, have the original track in my project for reference, and have a Max4Live device generate isolated stems of the different parts.
  - tomduncalf 4y ago
    I thought about the exact same thing when I first saw Spleeter and it turned out someone had already done it: https://github.com/diracdeltas/spleeter4max https://github.com/diracdeltas/spleeter4max Looks like the meat of this is using a JS script to invoke Spleeter using execSync so it might be quite simple to adapt to Demucs, maybe I’ll give it a go!