5 ms·

I had such an emotional experience using the visionOS 2 beta to spatialize old photos. It was already amazing seeing it take a photo from 15 years ago and turn

I had such an emotional experience using the visionOS 2 beta to spatialize old photos. It was already amazing seeing it take a photo from 15 years ago and turn it 3D; but then when I "pinched" into it to make it become immersive and was suddenly in a place I hadn't been in years, with my (then young) kids looking just as they did back then, seeming to be standing there in the room with me… it was profound. I can't think of any other experience with technology I've had that even comes close.

fire_lake 2y ago
This make somehow… uncomfortable. Perhaps humans are not meant to have perfect recall of, and dwell on, the past.
- glhaynes 2y ago
  I mean, I guess! I can’t say I feel damaged by it in the least (rather, enriched!), but I’m sure not every person will have the same experience.
nogridbag 2y ago
Is there a future proof way to capture photos today to view in 3D/VR devices of the future?
- glhaynes 2y ago
  (Not my area of expertise, but I believe this is about accurate with regard to the Apple ecosystem) These were old photos, many taken with older digital cameras and early smartphones, and they worked very well. I believe as long as they're of a reasonably high resolution (so, any camera from the last 20 years or even more), it'll work. Of course, it's ML-based attempting to simulate 3D from a single image, so it's not always perfect, but I didn't run into any significant failures. Btw, to capture spatial videos, the easiest way is to use an iPhone 15 Pro (with its camera in "spatial video" mode) or the Apple Vision Pro itself. I'd guess there are ways to convert videos from other formats into this, or to use other apps to view photos/videos in non-native formats, but I'm not personally familiar.
  - jachee 2y ago
    Panoramic photos also convert nicely into spatial experiences.
- crooked-v 2y ago
  For video, MV-HEVC (the Apple-pushed format) is probably the best bet, since it's both well-documented as a HEVC/H.265 extension and (because it stores diffs instead of full duplicate frames) it's way more practical for high-res and HDR video than previous de facto formats like side-by-side video. It's likely to be widely adopted by data hoarders, if only because it will save a huge amount of file space on 3D blu-ray rips. Photos are more up in the air in part because the use and support of the Apple-pushed HEIC is much more limited than HEVC. But internally it's basically the same thing as MV-HEVC except with just the two still frames encoded instead of full videos, so any codebase that supports MV-HEVC should be able to support the 3D variant of HEIC as well without a lot of extra work over the long term.
calf 2y ago
Wait what, it has an app that will convert a picture into a 3d environment? That's amazing.
- kridsdale1 2y ago
  Yes, it’s the iOS photos app (in visionOS 2.0) and it’s 100% the Killer App of the product.

fire_lake 2y ago

This make somehow… uncomfortable. Perhaps humans are not meant to have perfect recall of, and dwell on, the past.

glhaynes 2y ago
I mean, I guess! I can’t say I feel damaged by it in the least (rather, enriched!), but I’m sure not every person will have the same experience.

nogridbag 2y ago

Is there a future proof way to capture photos today to view in 3D/VR devices of the future?

glhaynes 2y ago
(Not my area of expertise, but I believe this is about accurate with regard to the Apple ecosystem) These were old photos, many taken with older digital cameras and early smartphones, and they worked very well. I believe as long as they're of a reasonably high resolution (so, any camera from the last 20 years or even more), it'll work. Of course, it's ML-based attempting to simulate 3D from a single image, so it's not always perfect, but I didn't run into any significant failures. Btw, to capture spatial videos, the easiest way is to use an iPhone 15 Pro (with its camera in "spatial video" mode) or the Apple Vision Pro itself. I'd guess there are ways to convert videos from other formats into this, or to use other apps to view photos/videos in non-native formats, but I'm not personally familiar.
- jachee 2y ago
  Panoramic photos also convert nicely into spatial experiences.
crooked-v 2y ago
For video, MV-HEVC (the Apple-pushed format) is probably the best bet, since it's both well-documented as a HEVC/H.265 extension and (because it stores diffs instead of full duplicate frames) it's way more practical for high-res and HDR video than previous de facto formats like side-by-side video. It's likely to be widely adopted by data hoarders, if only because it will save a huge amount of file space on 3D blu-ray rips. Photos are more up in the air in part because the use and support of the Apple-pushed HEIC is much more limited than HEVC. But internally it's basically the same thing as MV-HEVC except with just the two still frames encoded instead of full videos, so any codebase that supports MV-HEVC should be able to support the 3D variant of HEIC as well without a lot of extra work over the long term.

calf 2y ago

Wait what, it has an app that will convert a picture into a 3d environment? That's amazing.

kridsdale1 2y ago
Yes, it’s the iOS photos app (in visionOS 2.0) and it’s 100% the Killer App of the product.