4 ms·

Noise reduction, background removal. Technologies that have been around for ages. But now apparently it's "with the power of AI" so it's newsworthy?

by Ecco 6y ago

dgellow 6y ago
AI just means deeplearning here. The past few years have seen great improvement when applying deep learning to a bunch of already established domains, such as noise reduction and background removal
bayesianbot 6y ago
What other software would you suggest for good quality real time background removal? The ones I've tried I've been stuck with pretty bad artefacts.
- harvey9 6y ago
  I pinned a piece of green cloth behind me and used OBS with the virtual webcam plugin. Had someone in a meeting comment that there's no artifacts on my feed. He thought it was because I have a shaved head though.
  - travbrack 6y ago
    That's not the same thing as pushing a button and having a perfect key without doing anything to your environment
  - TomVDB 6y ago
    So all I need to do is buy a green cloth, and move it around when I take Zoom calls in the bedroom, living room, or the office. Lovely!
ryneandal 6y ago
Depends on where this product ends up, I suppose. If it learns and improves it's current performance with my admittedly noisy background, then the improvements on the technology would be pretty incredible. I mean, isn't the whole point of the tech industry to iterate on old tech and make life better with each improvement?
SXX 6y ago
It's newsworthy because it's actually good. Might be even exceptionally good if it's for average person with cheap microphone.
- Ecco 6y ago
  But is it really? The background removal doesn't seem better than Skype's: even in their demo the hair is all messed up…
  - SXX 6y ago
    Sorry. I should have specified I that I talking specifically about background noise cancellation for voice input. I haven't seen any other of this tech in action so can't comment on how good it is.
  - Godel_unicode 6y ago
    1, Given the use of the word microphone, I doubt they were talking about background removal. 2, How do you think Skype is doing it...? Here's a hint: the team has published a number of papers on convolutional neural networks.
HeWhoLurksLate 6y ago
IMO, this one's newsworthy because whatever they did works in click-boom fashion- no messing with gain or knobs or fiddling- there's a checkbox for remove noise, and a slider for how much you want to remove. I'd been trying to get rid of the noise in my mic forever- and RTX Voice just worked. (That being said, I also had to patch the installer, but like who cares? Someone else did the hard part of figuring it out already, and at that point in time, it was 'beta' software, as well.)
umutisik 6y ago
The deep learning based noise reduction is of significantly better quality than previous algorithms.
ponker 6y ago
And a Tesla is just a Power Wheels.
echelon 6y ago
Machine learning for signal processing is no joke. It's an order of magnitude improvement. The approach is different, too. Instead of approaching the signal mathematically with Fourier transforms and such, you approach it as part of a pipeline where you extract high level components such as pitch and timber. The ML model learns how to do that. This field is going to change everything. Look what I've been able to do with some of the recent ML innovations: https://vo.codes https://vo.codes
- nullsense 6y ago
  The next layer that would put the realism off the charts is ML that's able to replicate a given speakers idiolect, not just their voice. Mimicking people's ideolects is a hobby of mine, and I typed in phrases that Dr Phil would say, and the voice itself is good but the delivery is off enough that I know it's definitely not him. Im sure it all get there one day.

Noise reduction, background removal. Technologies that have been around for ages. But now apparently it's "with the power of AI" so it's newsworthy?

by Ecco 6y ago

Noise reduction, background removal. Technologies that have been around for ages. But now apparently it's "with the power of AI" so it's newsworthy?

dgellow 6y ago

AI just means deeplearning here. The past few years have seen great improvement when applying deep learning to a bunch of already established domains, such as noise reduction and background removal

bayesianbot 6y ago

What other software would you suggest for good quality real time background removal? The ones I've tried I've been stuck with pretty bad artefacts.

harvey9 6y ago
I pinned a piece of green cloth behind me and used OBS with the virtual webcam plugin. Had someone in a meeting comment that there's no artifacts on my feed. He thought it was because I have a shaved head though.
- travbrack 6y ago
  That's not the same thing as pushing a button and having a perfect key without doing anything to your environment
- TomVDB 6y ago
  So all I need to do is buy a green cloth, and move it around when I take Zoom calls in the bedroom, living room, or the office. Lovely!

ryneandal 6y ago

Depends on where this product ends up, I suppose. If it learns and improves it's current performance with my admittedly noisy background, then the improvements on the technology would be pretty incredible. I mean, isn't the whole point of the tech industry to iterate on old tech and make life better with each improvement?

SXX 6y ago

It's newsworthy because it's actually good. Might be even exceptionally good if it's for average person with cheap microphone.

Ecco 6y ago
But is it really? The background removal doesn't seem better than Skype's: even in their demo the hair is all messed up…
- SXX 6y ago
  Sorry. I should have specified I that I talking specifically about background noise cancellation for voice input. I haven't seen any other of this tech in action so can't comment on how good it is.
- Godel_unicode 6y ago
  1, Given the use of the word microphone, I doubt they were talking about background removal. 2, How do you think Skype is doing it...? Here's a hint: the team has published a number of papers on convolutional neural networks.

HeWhoLurksLate 6y ago

IMO, this one's newsworthy because whatever they did works in click-boom fashion- no messing with gain or knobs or fiddling- there's a checkbox for remove noise, and a slider for how much you want to remove. I'd been trying to get rid of the noise in my mic forever- and RTX Voice just worked. (That being said, I also had to patch the installer, but like who cares? Someone else did the hard part of figuring it out already, and at that point in time, it was 'beta' software, as well.)

umutisik 6y ago

The deep learning based noise reduction is of significantly better quality than previous algorithms.

ponker 6y ago

And a Tesla is just a Power Wheels.

echelon 6y ago

Machine learning for signal processing is no joke. It's an order of magnitude improvement. The approach is different, too. Instead of approaching the signal mathematically with Fourier transforms and such, you approach it as part of a pipeline where you extract high level components such as pitch and timber. The ML model learns how to do that. This field is going to change everything. Look what I've been able to do with some of the recent ML innovations: https://vo.codes https://vo.codes

nullsense 6y ago
The next layer that would put the realism off the charts is ML that's able to replicate a given speakers idiolect, not just their voice. Mimicking people's ideolects is a hobby of mine, and I typed in phrases that Dr Phil would say, and the voice itself is good but the delivery is off enough that I know it's definitely not him. Im sure it all get there one day.