3 ms·
Does the gyro really give much extra information that can't be inferred from the video feed itself? The complexity of simultaneously capturing the gyro output
by londons_explore 5y ago
Does the gyro really give much extra information that can't be inferred from the video feed itself?
The complexity of simultaneously capturing the gyro output and time syncing it to the video seems pretty high if the benefit is only marginal.
- WithinReason 5y agoI remember a colleague working on such a project about 7 years ago (he put together a prototype in 2 weeks). The reason the gyro makes a huge difference is that the image is not produced at the same time, the sensor rows are scanned out gradually, and a gyro allows you to assign a correction to each row of pixels instead only to the whole image at the same time. Doing the same through vision is close to impossible. edit: A gyro-based algorithm is quite simple, while computer vision is still not a fully solved problem in general
- Ancapistani 5y agoDefinitely. Syncing “blackbox logs” from the flight controller’s gyroscope is a pain, for sure. There are some cameras on the market now that have their own gyroscope and automatically produce sidecar files for the same time period as the video, like the RunCam 5 Orange. For those, syncing the gyro readings is totally a non-issue.
- zcw100 5y agoYou could infer the camera position and angle using Structure from Motion (SfM) and then stabilize the video from that but I'm guessing you'd get a lot of error built up in the process and it would be questionable how much stabilization you'd get in the end but it would be interesting to see how well it would work.