You need to dial in the fps. It's a little bit of work to try different parameters and might not work for every camera. But with most cameras I was able to get

You need to dial in the fps. It's a little bit of work to try different parameters and might not work for every camera. But with most cameras I was able to get the latency below 300ms which should work for most use cases.