3 ms·
Hey HN! This is a little demo of WebRTC insertable streams. This API has the possibility of opening up some exciting with WebRTC. The gist of it is that you h
by Sean-Der 6y ago
Hey HN!
This is a little demo of WebRTC insertable streams. This API has the possibility of opening up some exciting with WebRTC.
The gist of it is that you have access to the video frames in the browser now! You can see here [0] flipping bits in the browser (a simple XOR Cipher) that was applied here [1] in the Go code.
The use case I am most excited for is attaching metadata to frames. Especially for teleoperation a big ask has been attaching metadata to a specific frame, this makes it possible!
I also have a video demo on Twitter here[2] but not that exciting
[0] https://github.com/pion/webrtc/blob/master/examples/insertable-streams/jsfiddle/demo.js#L28-L38 https://github.com/pion/webrtc/blob/master/examples/insertab...
[1] https://github.com/pion/webrtc/blob/master/examples/insertable-streams/main.go#L97-L100 https://github.com/pion/webrtc/blob/master/examples/insertab...
[2] https://twitter.com/_pion/status/1271956810015010816 https://twitter.com/_pion/status/1271956810015010816
- amelius 6y agoHi, perhaps you could be a little more explicit in the README about what you mean by "insertable stream" for people without the background. Is this like a dataflow-graph where you can combine streams using generic "operation" nodes/functions? > The gist of it is that you have access to the video frames in the browser now! As a total newbie in this area, it sounds surprising that this wasn't already the case. Would you access these frames from Javascript or WebAssembly? Would this be efficient enough (in terms of speed and power use)?