5 ms·
I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser https://github.com/facebookresearc
by graderjs 4y ago
I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser https://github.com/facebookresearch/denoiser
I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI models strangely seem to pull info out of the dead space between words, and the noise around words...not just the voiced words themselves...the hidden vibrations, beyond our human ken, oh mere mortals unworthy of the grand perceptive machines...ugh...:p :o ;p xx ;p)
I contacted the authors via their FB emails but never heard back. Right now it's non-commercial and I was building a commercial product.
- causi 4y agoHow does it compare to Adobe's recent AI audio enhancement?
- graderjs 4y agoNot sure. Anyone else wanna chime in on that? BTW - in my search just now in response to your question, I see Dolby also has an API: https://dolby.io/products/enhance/ https://dolby.io/products/enhance/
- causi 4y agoInteresting that all of these seem to work extremely well but none are actually available to end users as an unrestricted product.
- bick_nyers 4y agoSomewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.
- bane 4y agoThat's called "speaker diarization" and there's quite a bit of work in the field. https://github.com/topics/speaker-diarization https://github.com/topics/speaker-diarization I have no idea what's good or the best, but there's a starting point!
- tomcam 4y agoI had speaker diarization and my wife and dog wouldn’t even come near me for weeks
- bick_nyers 4y agoThank you for the proper terminology, googling these things in plain English just doesn't do it anymore
- bane 4y agoNot a problem and good luck!
- iKlsR 4y agoI haven't tested this with multiple voices and it sounds like you want something more specific but it's produced 10/10 results with a couple dozen audio files I've thrown at it, might be of use... https://vocalremover.org/ https://vocalremover.org/
- rahimnathwani 4y agohttps://speechbrain.readthedocs.io/en/latest/API/speechbrain.lobes.models.ECAPA_TDNN.html https://speechbrain.readthedocs.io/en/latest/API/speechbrain...
- Slow_Hand 4y agoIzotope RX Pro, which is software for the cleaning and refinement of audio for music and audio post production includes 'Multiple Speaker Detection' which analyzes different voices in a recording and allows you to process them independently. https://www.izotope.com/en/products/rx.html https://www.izotope.com/en/products/rx.html I can't speak to it's effectiveness because I don't have any need for it, and also RX 10 Advanced is commercial software and pretty expensive for a casual user, but the feature seems to be on the horizon for other apps.
- stephanos2k 4y agoHave you tested https://hushaudioapp.com https://hushaudioapp.com ? Its quality is amazing.