11 ms·
Does it stem in real time? That is can you use it to do karaoke on an arbitrary song as it streams?
by genewitch 2y ago
Does it stem in real time? That is can you use it to do karaoke on an arbitrary song as it streams?
- input_sh 2y agoWhen you import a track to your collection, it does the processing. So, not completely in real time, but it only takes like a minute of background processing before it's ready. Virtually all DJ software has this as a feature nowadays, but of course, results vary. It's like the next "big thing", very few DJ controllers on the market right now have dedicated buttons for it, but that's about to change.
- crtasm 2y agoWith a GPU stems take seconds to generate, it happens on the fly when I load a file and the track can begin playing immediately while its running.
- genewitch 2y agoi've been using "AI/ML" to stem songs for something like 7 years, i was wondering if the state of the art allowed streaming stems yet or not. "next big thing" heh
- Shorel 2y agoStemming takes about 15 seconds for a 3 minute song. And most DJ software downloads the entire song in a few seconds, then generates the display waveforms, and so on, and then you can play the song. So "realtime" and "streaming" don't really apply, because the files download and process fast enough.
- genewitch 2y ago15 seconds for 3 minutes is quite slow, the open source thing i use, spleeter, says 100x speedup over realtime with a GPU, that would be 1.8 seconds for three minutes, which means that spleeter could, in fact, given all of the arguments of what i asked, do it "realtime".
- Shorel 2y agoIt depends on the hardware. The laptop I use for DJ doesn't have a dedicated GPU. I also use open source, preferring demucs over spleeter. In my experience spleeter requires huge amounts of memory, my DJ laptop only has 16GB of RAM, and I need to close the browser to be able to successfully stem a 5 minutes song. Demucs takes a bit longer, but it uses just 2GB of RAM. And the sound quality of the stems separation is much better with demucs, which is a more important factor than the runtime, IMO.
- genewitch 2y agothanks for the tip, i'll check out demucs!