Realtime server side rendering that updates with something like jpeg based live streaming? For example vnc can be pretty snappy because it only sends what's cha

Realtime server side rendering that updates with something like jpeg based live streaming? For example vnc can be pretty snappy because it only sends what's changed, and doesn't use video codecs, mostly libturbojpeg. If the mapping is mostly plane colors then I'd imagine it would be responsive enough. Maybe could get even more creative if all the map colors fit into 8 bit png's, purely hypothetical.