5 ms·

Thanks for giving it a try! If you are on Linux you could try to select a window and check if making it smaller still results in lags. Unfortunately the abilit

by HMH 6y ago

Thanks for giving it a try! If you are on Linux you could try to select a window and check if making it smaller still results in lags. Unfortunately the ability to playback videos via MSE API with low latency seems to vary quite a bit from device to device. You could also try an older release (v5.*). Those work by repeatedly sending PNGs and updating an image tag, actually the gif in the Readme is from that version. If this works better for you I will probably add it back as fallback in case video playback is to slow.

netsharc 6y ago
I'm guessing it's slow because capturing the display and encoding it takes a while? I wonder if you could integrate this HTML5 VNC client: https://github.com/novnc/noVNC https://github.com/novnc/noVNC , since the complicated stuff above will be taken care of by the VNC server. I feel like the boss in Office Space saying "if you could just go ahead and...".
- HMH 6y ago
  > I'm guessing it's slow because capturing the display and encoding it takes a while? This is a possibility but encoding is already pretty optimized (ffmpeg and libx264 with ultrafast as preset), which is faster than my previous approach of just streaming PNGs. And streaming PNGs was not that slow either, even on a rather old laptop. That's why I suspect there's something wrong on the tablet. Regarding noVNC: What latencies do they achieve? I am not a webdev so I guess they might have some more tricks up their sleeves, I will probably have a look. As far as I can tell noVNC does not support things like multitouch and pressure sensitivity so that rules out just using it (at least for my usecase).
lultimouomo 6y ago
Have you thought about having a companion mobile app instead of using the browser? If so, what made you go for a web based solution?
- HMH 6y ago
  Yes I have. I have decided to go with using a browser for now as I simply do not have the time to support multiple mobile apps and I am not too inclined to pay Apple 99$ for a Developer account. Personally I need this to work on my iPad, so you could consider using the browser as my way to break free of Apples walled garden :) If someone wants to build a mobile app I am more than happy to provide other means of connection to Weylus than websockets. This also might bring the latency down as udp streaming and more control over video decoding and playing is possible then.

by HMH 6y ago

netsharc 6y ago

I'm guessing it's slow because capturing the display and encoding it takes a while? I wonder if you could integrate this HTML5 VNC client: https://github.com/novnc/noVNC https://github.com/novnc/noVNC , since the complicated stuff above will be taken care of by the VNC server. I feel like the boss in Office Space saying "if you could just go ahead and...".

HMH 6y ago
> I'm guessing it's slow because capturing the display and encoding it takes a while? This is a possibility but encoding is already pretty optimized (ffmpeg and libx264 with ultrafast as preset), which is faster than my previous approach of just streaming PNGs. And streaming PNGs was not that slow either, even on a rather old laptop. That's why I suspect there's something wrong on the tablet. Regarding noVNC: What latencies do they achieve? I am not a webdev so I guess they might have some more tricks up their sleeves, I will probably have a look. As far as I can tell noVNC does not support things like multitouch and pressure sensitivity so that rules out just using it (at least for my usecase).

lultimouomo 6y ago

Have you thought about having a companion mobile app instead of using the browser? If so, what made you go for a web based solution?

HMH 6y ago
Yes I have. I have decided to go with using a browser for now as I simply do not have the time to support multiple mobile apps and I am not too inclined to pay Apple 99$ for a Developer account. Personally I need this to work on my iPad, so you could consider using the browser as my way to break free of Apples walled garden :) If someone wants to build a mobile app I am more than happy to provide other means of connection to Weylus than websockets. This also might bring the latency down as udp streaming and more control over video decoding and playing is possible then.