4 ms·

I was not so impressed with this demo - especially when he was scrunching his potato chip packet, the degradation in his voice quality made it almost impossible

I was not so impressed with this demo - especially when he was scrunching his potato chip packet, the degradation in his voice quality made it almost impossible to understand what he was saying and his voice sounded very synthesized and processed, and that's through a $200 Yeti professional microphone. Seems like some of the other noise cancellation technology options from Nvidia RTX and others are more effective.

SquareWheel 6y ago
Yeti microphones pick up everything. If anything it would make the test more difficult.
vkou 6y ago
You are correct. The sound quality of Nvidia RTX is amazing, compared to this. Unfortunately, you need a $400 graphics card, and >100 watts of power to run RTX...
- sp332 6y ago
  Unofficially, it's pretty easy to get it to run on non-RTX nvidia GPUs. https://www.pcgamer.com/nvidia-rtx-voice-performance/ https://www.pcgamer.com/nvidia-rtx-voice-performance/
  - bhauer 6y ago
    Not only that, but even when running RTX Voice on a GTX, the amount of GPU horsepower used is miniscule; it hardly even registers. The fans on my GTX 9-series GPU don't turn on when running RTX Voice.
    - bentcorner 6y ago
      +1. I'm using it on a 1060 and I've monitored sensors with OpenHardwareMonitor while RTX Voice is running. The only observable effect is that my GPU's clocks are turned up, there isn't even any significant load.
- cecja 6y ago
  My RTX 2080ti uses 5 Watt idle and 15 Watt with RTX Voice. Stop spewing FUD.
crazygringo 6y ago
Microphone quality has very little to do with it. Noise separation is just an incredibly hard problem, particularly when a noise is loud. Scrunching potato chips, there's no scenario where his voice won't become degraded unless you can isolate the scrunching sound separately (microphone beamforming can help here, but is still never perfect). Running this economically on servers at scale in realtime, I consider this very impressive. I can't say how it compares with RTX, but I wonder if it has anything to do with the amount of computing resources that can be dedicated to it. A single expensive card dedicated to one audio stream, versus a single Google server than needs to process hundreds (thousands?) of audio streams.
- tgsovlerkhgsel 6y ago
  Does this run client or server side?
- dannyw 6y ago
  RTX Voice uses less than 10% of a 2060 (non-super) Given how common voice communication is in our world, I am sure Google can build ASICs for this (if not just run it on TPUs), and get the marginal cost of vocal processing to be negligible. Heck, they probably would just need to divert <5% the resources of Fuschia or any other of their "senior engineer retention" projects.
jack_pp 6y ago
However that wasn't a realistic scenario, you are unlikely to talk while scrunching plastics, ideally you should get muted 100% when you do it. Only way this could happen is if someone is standing 3 feet away from you and does it while you talk which would just be rude and probably be stopped by you immediately anyway. I'm more curious how this could work in the metro or with a washing machine nearby

SquareWheel 6y ago

Yeti microphones pick up everything. If anything it would make the test more difficult.

vkou 6y ago

You are correct. The sound quality of Nvidia RTX is amazing, compared to this. Unfortunately, you need a $400 graphics card, and >100 watts of power to run RTX...

sp332 6y ago
Unofficially, it's pretty easy to get it to run on non-RTX nvidia GPUs. https://www.pcgamer.com/nvidia-rtx-voice-performance/ https://www.pcgamer.com/nvidia-rtx-voice-performance/
- bhauer 6y ago
  Not only that, but even when running RTX Voice on a GTX, the amount of GPU horsepower used is miniscule; it hardly even registers. The fans on my GTX 9-series GPU don't turn on when running RTX Voice.
  - bentcorner 6y ago
    +1. I'm using it on a 1060 and I've monitored sensors with OpenHardwareMonitor while RTX Voice is running. The only observable effect is that my GPU's clocks are turned up, there isn't even any significant load.
cecja 6y ago
My RTX 2080ti uses 5 Watt idle and 15 Watt with RTX Voice. Stop spewing FUD.

crazygringo 6y ago

Microphone quality has very little to do with it. Noise separation is just an incredibly hard problem, particularly when a noise is loud. Scrunching potato chips, there's no scenario where his voice won't become degraded unless you can isolate the scrunching sound separately (microphone beamforming can help here, but is still never perfect). Running this economically on servers at scale in realtime, I consider this very impressive. I can't say how it compares with RTX, but I wonder if it has anything to do with the amount of computing resources that can be dedicated to it. A single expensive card dedicated to one audio stream, versus a single Google server than needs to process hundreds (thousands?) of audio streams.

tgsovlerkhgsel 6y ago
Does this run client or server side?
dannyw 6y ago
RTX Voice uses less than 10% of a 2060 (non-super) Given how common voice communication is in our world, I am sure Google can build ASICs for this (if not just run it on TPUs), and get the marginal cost of vocal processing to be negligible. Heck, they probably would just need to divert <5% the resources of Fuschia or any other of their "senior engineer retention" projects.

jack_pp 6y ago

However that wasn't a realistic scenario, you are unlikely to talk while scrunching plastics, ideally you should get muted 100% when you do it. Only way this could happen is if someone is standing 3 feet away from you and does it while you talk which would just be rude and probably be stopped by you immediately anyway. I'm more curious how this could work in the metro or with a washing machine nearby