4 ms·
I'd like to have something else but for live calls: a process that takes two audio inputs and "subtracts" the noise from one input from the other. My use case w
by almog 2y ago
I'd like to have something else but for live calls:
a process that takes two audio inputs and "subtracts" the noise from one input from the other.
My use case would be to have two dynamic microphones, one directed at the window and one that I'm using for a conference call. I'm assuming having two inputs should make the process easier for real time (20ms?) processing and might require less compute.
If such process can output a clear sound, I could chain it with Blackhole and have it and use the processed clear signal as an input for the call.
- chankstein38 2y agoAssuming that this is setup so that the same sound is coming through both microphones just one with your voice on top, you could theoretically do this just by feeding it through something that inverts the polarity of the "to be cancelled out" sound and overlays the two sounds. I'm sure it wouldn't be perfect but you might be able to tune it to properly do it. This is how a active noise cancelling works!
- almog 2y agoThank you for the idea. I've tried in the past to do something similar but couldn't get it right. I did try to rely on ideas from ANC but my domain knowledge is very lacking. It's been over 2 years since so I might need to give it another chance and see if any off the shelf library/product has been released since then.
- CPLX 2y agoThat doesn’t work though, the requirement for the timing to align waveform by waveform is too high, and the speed of sound is too slow. Also the frequency response isn’t going to match exactly. To do it right you really want digital analysis.
- inhumantsar 2y agoDeepFilterNet doesn't use a second microphone but it does do an absurdly good job of removing not-speech from inputs in realtime. Check out the demo video linked in the README. iirc they demonstrate removing guitar sounds and even a vacuum cleaner. It does take some technical elbow grease to integrate but I've used it in calls and while gaming on Linux via Pipewire to great effect. https://github.com/Rikorose/DeepFilterNet https://github.com/Rikorose/DeepFilterNet
- almog 2y agoThe demo looks very impressive, I'll try it out, thank you!
- tapoxi 2y agoDon't most smartphones these days have a second noise cancelling microphone?
- almog 2y agoYes but I was looking for a way to run a process that does that on your desktop because I'd like to do ANC using two dynamic mics.
- DidYaWipe 2y agoI think they do. I've also had huge problems with Zoom when talking to my parents, because for some reason they are aggressively muted for several seconds while nobody else on the call is canceled like that. If anyone else on the call so much as clears his throat, my parents are muted and we all have to sit silently waiting for them to be able to talk. Annoying as shit. I suspect that this is noise cancellation that's failing because they keep their phone far away from themselves, to fit two people in the shot; and audio is bouncing off the walls or otherwise suffering enough delay to mess it up.
- conception 2y agoKrisp does a pretty great job of this currently without the two mics.
- almog 2y agoThanks, haven't tried it yet. Are you using it with a dynamic mic? Did you get the same crisp detailed sound as you get when using the mic as a raw input?
- conception 2y agoI’ve just used it for conferencing only and never really noticed a difference except in really noisy environments like a data center row.
- almog 2y agoI tried Krisp a bit, it works okay but it takes 1.5+ GB of RAM even when not actively used so maybe I'll check it again in the future to see if it can do better on that.
- DidYaWipe 2y agoYou'd think every DAW would have something like this: Subtract everything that's stereo (AKA keep only the sound that's present in both channels). I have old mono records that I wanted to clean up. In that case, any stereo content is obviously scratches and surface noise, so removing it would be most of the job. But nope... not one DAW offered this filter, despite offering the opposite (removing mono content and keeping the stereo). And yes I did try removing the mono content and then subtracting the result from the full source, but this didn't work; I don't remember (or know) why.
- recursive 2y agoVoxengo MSED is a free VST that can set gain/level on mid and side independently. https://www.voxengo.com/product/msed/ https://www.voxengo.com/product/msed/
- DidYaWipe 2y agoCool, thanks. I'll check it out.
- efilife 2y agomaybe you just didn't know how to do it. You can do this easily in FL studio (even free version) using stereo shaper
- DidYaWipe 2y agoNever heard of "FL studio."
- efilife 2y agoReally? This is (probably) the most popular DAW nowadays! It has a free trial and the only limitation is you can't open previously saved projects, but rendering works as normal. Give it a try. If you still need to isolate the mono signal, put stereo shaper on the mixer channel and choose (right click two arrows at the top of the plugin) one of the presets called mid or something, I don't remember now. It's that easy
- blep-arsh 2y agoI've been looking at https://github.com/xanguera/BeamformIt https://github.com/xanguera/BeamformIt but haven't had time to give it a go yet
- muziq 2y agoNvidia Broadcast. Does an amazing job of removing background noise from audio.. Only for Nvidia GPUs though.. Not sure if it’s still RTX only though..