3 ms·

I'm really interested to see how high level the support is for "spatial computing" is in the APIs they are offering. This whole thread is full of people wildly

by zmmmmm 3y ago

I'm really interested to see how high level the support is for "spatial computing" is in the APIs they are offering. This whole thread is full of people wildly speculating about applications which, without amazing platform level support are each going to be a small miracle in state of the art computer vision applications. Can they offer full 3d image detection / segmentation to give you a full spatial model of the user's environment? If not, a lot of people are going to be sorely disappointed by the amount of computer vision expertise required to get even basic apps they are envisioning to work. On the other hand if Apple does offer this type of platform support, it will be quite revolutionary. Meta has offered a range of spatial computing APIs for a while but they have been slow to take off. The Quest 3 should really push this along though. It will be fascinating to watch the two platforms compete on this front.

jlmendezbonini 3y ago
Can you elaborate why you think that the Quest 3 can push this along?
- zmmmmm 3y ago
  So far Meta has published a whole bunch of spatial APIs including scene detection, spatial anchors, plane detection etc. [0] They are far ahead of Apple in many of these respects, but what they haven't had is a device that made this attractive to actually develop for in any meaningful way. Quest Pro lacks a depth sensor and has too small a market presence to attract a lot of developers, while Quest 2 has ugly, black and white low resolution pass through. So Quest 3 will be the first spatial computing device the world has ever had access to that is available at mass market price (<$500) with depth sensor and high quality pass through. It will finally be worthwhile for developers to build mixed reality apps targeted to regular consumers. https://developer.oculus.com/documentation/unity/unity-spatial-anchors-overview/ https://developer.oculus.com/documentation/unity/unity-spati...
  - pzo 3y ago
    Based on what you mentioned all of those are also available in ARKit or Vision API: plane detection (vertical and horizontal), anchors (both local and geolocated), 3d scene reconstruction, 3d object reconstruction, custom planar markers, qrcode & barcodes, 3d human pose skeleton, 3d hand skeleton, face landmarks mesh, world tracking (SLAM), text detection. Haven't checked Meta APIs but it doesn't look for me as far ahead of Apple.
    - zmmmmm 3y ago
      well, it's ahead in the sense that you can walk out and buy one today, and they have 20M devices in the market running these APIs already

by zmmmmm 3y ago

jlmendezbonini 3y ago

Can you elaborate why you think that the Quest 3 can push this along?

zmmmmm 3y ago
So far Meta has published a whole bunch of spatial APIs including scene detection, spatial anchors, plane detection etc. [0] They are far ahead of Apple in many of these respects, but what they haven't had is a device that made this attractive to actually develop for in any meaningful way. Quest Pro lacks a depth sensor and has too small a market presence to attract a lot of developers, while Quest 2 has ugly, black and white low resolution pass through. So Quest 3 will be the first spatial computing device the world has ever had access to that is available at mass market price (<$500) with depth sensor and high quality pass through. It will finally be worthwhile for developers to build mixed reality apps targeted to regular consumers. https://developer.oculus.com/documentation/unity/unity-spatial-anchors-overview/ https://developer.oculus.com/documentation/unity/unity-spati...
- pzo 3y ago
  Based on what you mentioned all of those are also available in ARKit or Vision API: plane detection (vertical and horizontal), anchors (both local and geolocated), 3d scene reconstruction, 3d object reconstruction, custom planar markers, qrcode & barcodes, 3d human pose skeleton, 3d hand skeleton, face landmarks mesh, world tracking (SLAM), text detection. Haven't checked Meta APIs but it doesn't look for me as far ahead of Apple.
  - zmmmmm 3y ago
    well, it's ahead in the sense that you can walk out and buy one today, and they have 20M devices in the market running these APIs already