3 ms·
Vision Pro, Spatial Video, and Panoramic Photos
- macintux 3y agoGruber’s review definitely makes me more excited for Vision Pro, though I’m not sure I’ll ever own one. My prescription is pretty tough, so I don’t know that it’ll be an option. What he says about panoramic photos resonates with me this week in particular: I recently acquired a 6x17cm panoramic film camera, and printed a photo on a huge Epson printer, and it is absolutely stunning, to the point that I’m suddenly pricing out wide format printers and ruminating on where in the world I could hang or even sell photos. I can definitely see how Vision Pro would make iPhone panoramic photos sing. (Reposted my comment from yesterday.)
- germinalphrase 3y agoMy father did enormous panoramic photography. Fully down the path you’re going. They are very cool - but most of them live rolled up in tubes. They’re simply too hard to display outside of a gallery. Edit: they really are beautiful. This was not meant to dissuade.
- two_handfuls 3y agoThis article really should say what “spatial video” is within the first two paragraphs. At best I could gather, those are just 3D videos in 1080p.
- abrichr 3y agoAccording to [1], the key differentiator is parallax, i.e. the positions of objects change relative to each other, depending on how the viewer is looking at them. [1] https://www.youtube.com/watch?v=pmqr6ydIzDA https://www.youtube.com/watch?v=pmqr6ydIzDA
- two_handfuls 3y agoSee that information would have been super helful in the article. Thank you!
- avalys 3y agoHow is that achieved by capture on the iPhone 15 with the two lenses just 2 cm apart?
- abrichr 3y agoMy guess is Neural Radiance Fields [1], or something quite similar. https://www.matthewtancik.com/nerf https://www.matthewtancik.com/nerf
- dTal 3y agoDefinitely not anything like that. You need dozens of calibrated images, long training time, and - until Gaussian Splats - non-realtime reconstruction. This is something relatively trivial that runs in realtime on nothing more than stereo pairs. There's simply not enough information to extract anything more than a crude depth map.
- dTal 3y agoI would imagine by calculating a depth map from the stereo pair, then reprojecting onto that. This would give the "Minority Report" look described. No mention of artifacts in the article, but unless some clever AI infilling were done it would be very obvious with even small head movements.
- two_handfuls 3y agoThe next question is: how far can we move before the image shows obvious artefacts?
- dchuk 3y agoGreat now I want a Vision Pro. Spatial video sounds incredible, and talk about product ecosystem lock in given your phone can record these so easily. Very curious to see the evolution of these headsets both in regular use in society, as well as their technical evolution over time as they become smaller faster lighter etc.
- JCharante 3y agoGPT4 and Vision Pro are the gadgets that make me feel like I’m living in the future.