11 ms·
Maybe? What happens when some people on the call are not sending the alpha though? Background segmentation remains a hardware-dependent feature. Without the al
by pavlov 3y ago
Maybe? What happens when some people on the call are not sending the alpha though? Background segmentation remains a hardware-dependent feature.
Without the alpha, you can either skip the participant, render them unmasked, do the expensive segmentation on the receiver side (where the rendering happens), or do some kind of fast approximation for a mask.
Personally I would probably try to implement this feature first without the alpha channels, maybe just using face detection to get a passable mask cheaply. In a layout with a grid of people and a fancy complex background design, the requirements for mask quality are not quite as strict. There are compositing tricks that could obfuscate the cheap masking.