This isn't challenging. It is done for a majority of conference software. Essentially the client uploads the streams in such a way that they "depend" on each ot

This isn't challenging. It is done for a majority of conference software. Essentially the client uploads the streams in such a way that they "depend" on each other. You can imagine there is a base stream at 480p 15fps, then you can add on some packets to get 480 30fps, and further to get 720fps. https://webrtcglossary.com/svc/ https://webrtcglossary.com/svc/