7 ms·
Most people have no idea of the amount of incredibly advanced signal processing that goes into echo cancellation and noise cancellation in videoconferencing. T
by crazygringo 6y ago
Most people have no idea of the amount of incredibly advanced signal processing that goes into echo cancellation and noise cancellation in videoconferencing.
This post is on noise cancellation specifically, and it actually has the potential to be a huge step forward.
One of the big audio problems with group meetings is that the background noise from each participant adds up, to a point where it quickly becomes unbearable. For that reason, videoconferencing generally only plays audio from one or two participants at most, using a fairly simple estimation of whichever audio signal is currently loudest. The problem is that this can make it really hard to interrupt (people will literally not hear you), or tell the difference between two people going "mm-hmm" versus the whole group. If you've ever been in a group meeting where everybody applauds something, this is why you see everyone applauding but only hear a smattering.
But if this noise cancellation really succeeds, it could be a huge leap forward because audio cues and overlap will actually work for the first time -- hearing the "mm-hmms", hearing everyone pipe up, and so on. Videoconferencing will feel more like an actual single shared audio environment, rather than the kind of "walkie-talkie" effect it so often feels like now.
I'm really looking forward to this.
- amelius 6y agoHasn't the problem been solved decades ago, with car-kits? It seems that what's old is new again ...
- throwaway9482 6y agoWhat’s a car-kit? Just googled but didn’t find anything relevant
- amelius 6y agoThose adapters that let you use your phone through the audio system of your car (adapter does the noise-cancelling).
- throwaway9482 6y agoAh I see never heard of them
- hn_throwaway_99 6y agoWhat do you mean by car-kits?
- qmmmur 6y agoNo, not even close. The problem space is still mostly unsolved.
- krapht 6y agoOf all companies poised to solve it, I think Apple could do it if they wanted. They could embed microphones in the laptop frame and integrate it with the camera as a premium feature, since they control the hardware and software stack. It's more practical than a touch bar, at least.
- pathseeker 6y agoNo, as evidenced by the fact that you can almost always hear when a participant calls in from their car. When they start talking, you hear the road noise in the background. The only thing car-kits seemed to do was add minimum cut-offs before transmitting and make use of directional microphones.
- microcolonel 6y agoAny thoughts on spatialization or panning? I feel like it could help a lot, but also making it a good experience could involve head tracking, since most people are (hopefully) not accustomed to speaking in a different direction than the person they're speaking to.
- krapht 6y agoI dream of the day when our laptops come with an integrated microphone array with automatic beamforming based on head tracking.
- lowdose 6y agoI wish Tinder came with the ability to beam me up.
- microcolonel 6y agoI mean, automatic beamforming microphones are actually fairly common now, in laptops. Head tracking is probably a detour if your goal is just to get good clear voice input.
- tinus_hn 6y agoSome HP laptops have this and it’s terrible. Perhaps it would be useful if it selected the right sound 100% of the time but in reality all you get is audio cutting all the time with no explanation.
- squeaky-clean 6y agoI used to use panning back when I played WoW "seriously" and did 25 man raids, it makes hectic audio chat sooo much more clear. Some gaming voice apps can dynamically pan voices in 3D to match where the characters are, but I didn't use any of that. Just simply putting Guild Leader center, Tanks ~25% right, Healers ~25% left, and then randomly throwing everyone else somewhere wider in the stereo field. It sounds like an actual group of people rather than a single overlapping mono mess.
- 6y ago
- the_af 6y ago> The problem is that this can make it really hard to interrupt (people will literally not hear you) This is driving me crazy with Google Meet in these COVID19 times. Even in a relatively small conference, I have a really hard time interrupting someone to ask a quick question, even when the speaker is expecting interruptions. It's always "excuse me!"; delay as person continues speaking; I stop; the other person says "yes, please ask away"; when I restart my question the other person already assumed I've changed my mind and continues speaking; repeat ad infinitum. And this is if they even hear me over the audio breaking up. It's very, very frustrating. If they solve this it would hugely improve quality of life in remote conferencing for me.
- jmole 6y agoThe biggest reason for this is people not using headsets. If someone is just using their laptop speakers and mic, Meet will prioritize the mic if they're talking and will duck any audio that comes through the speakers.
- znpy 6y agoI have headsets and tried pretty much everything. there's always background noise from me. I'm even using the audio cable with my bluetooth (!) headsets, turning bluetooth off. I don't know what else I can do.
- rob-olmos 6y agoI use a Plantronics Legend bluetooth headset, which is pretty good at cutting out background noise. Tested with a phone. Cheaper bluetooth headsets seem to pick up everything around them. Had that issue with a coworker where the headset was worse than using the internal mic. Biggest and annoying issue though is consistent bluetooth disconnect/reconnect issues even on different MacOS machines. Latest firmware and such. Pretty sure it's not 2.4ghz interference.
- gxqoz 6y agoI've heard that the original Bluetooth standard is pretty terrible for audio, especially for microphones. On Windows PCs at least, old protocols can cause a bad experience: "Modern high-end Bluetooth headsets support AptX, an audio codec compression scheme that offers better sound quality. But AptX is only enabled if it’s supported on both the transmitter and receiver. When using a Bluetooth headset with a PC, it only works if your PC’s hardware and drivers are compatible." (https://www.howtogeek.com/354321/why-bluetooth-headsets-are-terrible-on-windows-pcs/ https://www.howtogeek.com/354321/why-bluetooth-headsets-are-...) Not sure if this applies to a Mac though.
- rb808 6y agoI wish everyone would just get a headset. It drives me nuts when people call me on speakerphone, of course they never hear the problem.
- pas 6y agoTell them you can't hear them due to noise, tell them to pick up the phone or plug in a headset, etc.
- faeyanpiraat 6y agoThey will probably tell you everyone else hears them, so the problem is on your end. People just don’t care about quality, they will gladly use the crappiest mic with all the noise all day..
- pas 6y agoI mean they can tell whatever they want. I organized my work around the fact that I can tell people to go fuck themselves when they are uncooperative in these small but very important ways. Obviously that's not the reality for ~90% of people today. But people shouldn't take "workspace" abuse from others. Be polite, assertive, constructive. Give them credit for taking the time to care a bit about this problem, offer to debug with them later, try to demonstrate it - switch to speaker, capture what you hear. Alternatively just switch off voice and type. Tell them that the sound is garbage for you so you switched for typing. Try to do quick 1-on-1s instead of the group call, even offer to write a summary after. This is basically the equivalent of constantly not giving a fuck about how loud one is in an open office. There ought to be proper channels [ha, no pun intended] to address and solve these.
- vorpalhex 6y ago> videoconferencing generally only plays audio from one or two participants at most I have noticed this and I hate it. It makes normal conversation absolutely impossible. Discord, which is an audio first product, is much better than other solutions in this regard and their video conferencing while new has been very enjoyable to use.
- m463 6y agothere are products that do this now with all kinds of apps: https://www.nvidia.com/en-us/geforce/guides/nvidia-rtx-voice-setup-guide/ https://www.nvidia.com/en-us/geforce/guides/nvidia-rtx-voice... I think you can do it not only to your microphone (outgoing audio), but to the other participants in the meeting (incoming audio)
- asdfman123 6y agoThis will be a game changer on online gaming, too (pun intended, I guess). I don't even like playing games that require headsets and teamwork because the background noise makes my ears physically hurt after long enough.
- dmos62 6y agoThat's exciting. Isn't this difficulty one of the reasons why open-source VOIP clients are rare?
- gsich 6y ago>One of the big audio problems with group meetings is that the background noise from each participant adds up, to a point where it quickly becomes unbearable. Just use proper equipment. Headset is an absolute must. Next step is software that only transmits when someone is talking. Gamers have figured this out decades ago. Just look at Mumble, Teamspeak, Discord. They know. People without proper headsets in that environment get ignored after a while. Nobody wants to use brainpower to understand what you are saying. Corporate might be harder, but you also get payed for that.
- ghaff 6y ago>Most people have no idea of the amount of incredibly advanced signal processing that goes into echo cancellation and noise cancellation in videoconferencing. We pretty much take echo cancellation for granted at this point. Using something better than your laptop microphone on a call is still a good idea but I'm not sure that wearing headphones/earphones is that big a deal at this point. You don't need to go back that far until speakerphones other than very expensive Polycoms and the like were pretty mediocre at cutting out because of echo.
- deleted 6y ago[deleted]
- Terretta 6y agoSee also https://krisp.ai https://krisp.ai Mute your or participants' background noise in any communication app https://krisp.ai/technology/ https://krisp.ai/technology/