3 ms·
Microphone quality has very little to do with it. Noise separation is just an incredibly hard problem, particularly when a noise is loud. Scrunching potato chip
by crazygringo 6y ago
Microphone quality has very little to do with it. Noise separation is just an incredibly hard problem, particularly when a noise is loud. Scrunching potato chips, there's no scenario where his voice won't become degraded unless you can isolate the scrunching sound separately (microphone beamforming can help here, but is still never perfect).
Running this economically on servers at scale in realtime, I consider this very impressive. I can't say how it compares with RTX, but I wonder if it has anything to do with the amount of computing resources that can be dedicated to it. A single expensive card dedicated to one audio stream, versus a single Google server than needs to process hundreds (thousands?) of audio streams.
- tgsovlerkhgsel 6y agoDoes this run client or server side?
- dannyw 6y agoRTX Voice uses less than 10% of a 2060 (non-super) Given how common voice communication is in our world, I am sure Google can build ASICs for this (if not just run it on TPUs), and get the marginal cost of vocal processing to be negligible. Heck, they probably would just need to divert <5% the resources of Fuschia or any other of their "senior engineer retention" projects.