For ESRGAN I would say there is still ways to go for it to be useable in realtime. The shown image at an input resolution of 309x237 pixels takes about 7 second

For ESRGAN I would say there is still ways to go for it to be useable in realtime. The shown image at an input resolution of 309x237 pixels takes about 7 seconds to process with my own model on a GTX1080.