It sounds like you want to do adaptive bitrate streaming. This [1] blogpost probably does better justice than I could do. I think it kind of sounds similar to

It sounds like you want to do adaptive bitrate streaming. This [1] blogpost probably does better justice than I could do. I think it kind of sounds similar to what you were mentioning, but it sounds like the lowest possible latency solution is to stream multiple streams of different bit rates at the same time and then WebRTC picks up the best one it can. [1] https://bloggeek.me/webrtc-simulcast-and-abr-two-sides-of-the-same-coin/ https://bloggeek.me/webrtc-simulcast-and-abr-two-sides-of-th...