3 ms·
Hm. Doable. I think the hard part for that then might be getting the real time information about the position and orientation of the viewfinder in high enough
by loxias 5y ago
Hm. Doable. I think the hard part for that then might be getting the real time information about the position and orientation of the viewfinder in high enough resolution.
Keep in mind "the black box" can output the position in 3 space (x,y,z, measured in mm) of coherent sound sources, but to know where those are relative to the camera, so that once can draw a little arrow, can be hard.
I'd like to try hooking it up to a VR/AR headset, since I imagine those already handle the task of knowing precisely where my head is and where it's looking.
- zlsa 5y agoI think this might be possible with a phone that has AR support - you'd scan a QR code on the sound camera to capture its position relative to the world, then the phone could display a 3D view through the camera of where the sound source(s) are.
- loxias 5y agoOh that's interesting! Is your thinking something like: 1. mount the array on a tripod somewhere in the frame of the camera 2. the array is covered with an assortment of fiducials, 3. software uses the known intrinsics and extrinsics of the camera to figure out the array position relative to the camera 4. do the obvious thing with chaining transforms until you get the sound source position relative to the camera If so, I think that would work, but would be a lot of coding to do all that CV... > phone that has AR support I take it cell phones now do much of this work?