4 ms·

Don’t get me wrong this is pretty cool, but one thing that makes me a bit annoyed is the way the author frame the video. With the current version of ARkit and m

Don’t get me wrong this is pretty cool, but one thing that makes me a bit annoyed is the way the author frame the video. With the current version of ARkit and most AR libraries these days, there’s no occlusion of the virtual geometry, meaning that you can actually see the blue line and arrows overlay the real world at all time (So some far away virtual arrow will be on top of a real wall right in front of you). That’s a bit less sexy and it’s clearly hidden here. It’s also possible that some directions look confusing with the lack of occlusion and too numerous virtual objects on the screen. I’m looking forward to when AR libraries use their point cloud technology to also do object reconstruction and virtual occluders using real world objects!

bflood 9y ago
I agree it'll be amazing when device depth sensors can build up the occlusion mask on the fly, but that still requires a hardware upgrade (iPhone8?, android tango etc). IMO, the beauty of ARKit is getting reasonable AR tracking on the current crop devices (with a single camera lens!) also, I think there are other ways to build up reasonable occlusion nodes manually. for example, its probable that the Google Maps iOS team is currently adding an AR directions view that use the Streetview point cloud to build up occlusion areas around most streets. Likewise, some areas of the OSM dataset include building footprints with height attributes, this could be used as well. No where near perfect but I think it would help in the situation you described above
- kalleboo 9y ago
  Well the current iPhone 7s with its dual cameras can generate a realtime (albeit low-res) depth map in the iOS 11 beta, so you could probably get one working (probably somewhat crudely)
pj_mukh 9y ago
Project Tango can kind of do this already, albeit the quality of the pointcloud tends to break the illusion. The other solution, at this large scale, is to have pre-baked maps, we know where all the big occlusions are in a city.
carlosdp 9y ago
Hololens' occlusion is pretty solid.
nobbis 9y ago
We're planning to bring occlusion to ARKit with Forge. The accuracy can't match a depth camera, but still plenty of use cases. Here's an example on a Pixel: https://www.youtube.com/watch?v=K9CpT-sy7HE https://www.youtube.com/watch?v=K9CpT-sy7HE
- mendeza 9y ago
  This is awesome! Is the sdk available?

bflood 9y ago

I agree it'll be amazing when device depth sensors can build up the occlusion mask on the fly, but that still requires a hardware upgrade (iPhone8?, android tango etc). IMO, the beauty of ARKit is getting reasonable AR tracking on the current crop devices (with a single camera lens!) also, I think there are other ways to build up reasonable occlusion nodes manually. for example, its probable that the Google Maps iOS team is currently adding an AR directions view that use the Streetview point cloud to build up occlusion areas around most streets. Likewise, some areas of the OSM dataset include building footprints with height attributes, this could be used as well. No where near perfect but I think it would help in the situation you described above

kalleboo 9y ago
Well the current iPhone 7s with its dual cameras can generate a realtime (albeit low-res) depth map in the iOS 11 beta, so you could probably get one working (probably somewhat crudely)

pj_mukh 9y ago

Project Tango can kind of do this already, albeit the quality of the pointcloud tends to break the illusion. The other solution, at this large scale, is to have pre-baked maps, we know where all the big occlusions are in a city.

carlosdp 9y ago

Hololens' occlusion is pretty solid.

nobbis 9y ago

We're planning to bring occlusion to ARKit with Forge. The accuracy can't match a depth camera, but still plenty of use cases. Here's an example on a Pixel: https://www.youtube.com/watch?v=K9CpT-sy7HE https://www.youtube.com/watch?v=K9CpT-sy7HE

mendeza 9y ago
This is awesome! Is the sdk available?