6 ms·

Spatial Computing

88 points by ingve 3y ago

Animats 3y ago
[flagged]
- elicash 3y ago
  This isn't a review of the product. I think the public information is all you need to claim that Vision Pro asks you to look at objects and then use gestures like quickly putting your fingers together. In this post, he reflects on the evolution of spatial computing -- opposing claims that such a thing is a new idea -- and concludes by simply saying he "wonder[s]" if this interaction model will hold up as well as others. But the point is to put it in historical context, not to render a judgment. To me, the link back to his 2003 piece that talked about spatial interfaces was a really interesting way to view the AVP interaction model with a broader perspective. His voice is interesting here because he's written for decades about small interactions on the Mac and gone deeper into the details than maybe anybody.
mcbishop 3y ago
I think the eventual "direct manipulation" is to manipulate directly with the mind... no physical movement required.
- blkhp19 3y ago
  I could see there being serious issues with handling "impulse control." Imagine you see an ad, have a brief desire to interact with it, but tell yourself a split second later that you shouldn't. The time delay of using our physical body to carry out actions (movement, speech) that originate as thoughts acts as a very necessary filter. Imagine a world, even isolated to a spacial computing environment, where this filter didn't exist.
  - yurishimo 3y ago
    I think there are two minds to this. One, with software, you could delay any action for a set amount of time as such to give your brain time to make a more concrete decision. Idk how long that delay needs to be, but I'm guessing it's less than 300ms. On the other hand, if the hardware is responsive enough, you can simply decide to close the program/ad/whatever another split second after that fleeting thought. The pessimist in me thinks that the first option is probably the best one given software optimization in the past two decades, but who knows.
    - dimask 3y ago
      > One, with software, you could delay any action for a set amount of time as such to give your brain time to make a more concrete decision. Is there a type of software that already does this? Because it is not like it could not be implemented right now, nor that it would not be useful right now for the exact same reasons. Of course it is completely against most corporations' interests, so not sure who would produce that in the first place.
      - jsjohnst 3y ago
        > Is there a type of software that already does this? Several email clients including Gmail have the ability to have a short delay from clicking “Send” till it actually does the send to allow you the ability to undo.
        dimask 3y ago
        Yes but I assume that people do not usually get "addicted" to sending emails, and that feature seems more oriented towards making sense one did not forget sth or clicked send by mistake (has happened to me). What we talk about would be more relevant in social media, both in passively consuming and in participating more actively.
  - eviks 3y ago
    Why wouldn't you simply add a filter if it's an issue?
trinsic2 3y ago
I don't know if the Visison Pro is like other 3d head sets, but I realized there is more of a cognitive load on the brain then just using a 2d screen. I think it has many applications, but I wouldn't want to be using it for long periods of time.
- CoolestBeans 3y ago
  You really put into words something I've experienced but couldn't articulate. Every time I've used a headset I've gotten not fatigued but just a general feeling of malaise and had to put it down and take a break. I would imagine with repetition you get used to it but yeah its definitely a factor. Although I think part of the bleh feeling is just having to subconsciously adapt to the imperfections of a headset. For example, you can't just glance at anything and expect to see it, you have to shift your head for some things. Or like the headset itself moving ever so slightly on the face and your eye moving out of the way of the center of the lens. It gets exhausting and you don't know you're doing it unless you're actively paying attention. I will say most of the advertising shows people interacting with 2D interfaces in 3D space so maybe this is how they're getting around it combined with just better build quality, better thought out straps, etc.
  - trinsic2 3y ago
    Yea maybe you can get used to it. I have only used heat sets a few times. One thing I noticed was that My brain had two visual maps competing against each other. Reality and the virtual world. I sometimes found myself feeling the sensations from the virtual world from time to time while I was not using the head sets. It went away with time, but it was interesting anyway.
threeseed 3y ago
The whole point of the eye/finger mechanism is so that you can just pickup the headset at any time, watch a movie or play a game without needing to worry about finding and charging controllers. For doing proper work the keyboard/trackpad combination looks to be ideal.
- realharo 3y ago
  For navigating menus, even the original Quest's hand tracking, where you used your fingers to point at things, is good enough.
  - crazygringo 3y ago
    The Quest 2's hand tracking is so bad as to be literally unusable for me. I just cannot get it to reliably recognize pinching. It's like only half the time, and sometimes I have to pinch like ten times in a row until success. Or the act of pinching also moves the hand off the item you're trying to click. And then certain things your on-screen hands just can't reach. Super unclear why. But I think something to do with trying to map hands close to you, to an interface button visually one or two meters away.
jojobas 3y ago
12 years after Oculus Rift SDK VR is still a gimmick that only ~10% of the relatively few owners use weekly. Calling it "spatial computing" won't change it.
- ildjarn 3y ago
  The second screen stuff has commercial applications.
muunbo 3y ago
One important aspect missing is tactical feedback. The mouse, keyboard, and touchscreen all provide that but Vision Pro doesn’t. We have evolved several nervous system sensors (touch, pressure, temperature) for this and it is just as “human” as spatial reasoning and hand manipulation of objects
- meheleventyone 3y ago
  That combined with a noisy signals from inferred controls with eye and hand tracking will frustrate a lot of people. Our current interfaces are extremely precise in comparison. I quickly narrowed down on VR experiences that provide a decent feeling of facsimile to real life being the most interesting and engaging. Beat Saber is a case in point here but for me it was combat flight sims using stick, throttle and pedals. Moving to gestures and eye tracking wrecks all of that. I also don’t know why the original article calls using a mouse indirect as if we aren’t masters at that as well. As well as a spatially aware species we are also a tooling using species. We are experts at leveraging our spatial reasoning to manipulate tools in the world to do things we otherwise couldn’t. A mouse movement in the world translating to moving a cursor on screen is a perfect fit.
- threeseed 3y ago
  There is tactical feedback on the Vision Pro for selecting, scrolling and moving. I suspect that we are going to see most apps centre around this finger/thumb motion.
  - dvh 3y ago
    Do you and op mean tactile?
    - muunbo 3y ago
      Yes whoops tactile
- eviks 3y ago
  There is no tactile UI feedback in VPro, but then neither is it there in the mouse/keyboard. Otherwise when you touch your fingers against each other for some gesture, you feel them.
LeoPanthera 3y ago
There's one huge advantage to the "indirect manipulation" of the Vision Pro - you aren't limited to the space around you that you can reach with your hands. The Vision Pro allows you to manipulate things that are too far away to reach. I don't know if this will "feel" good or not, I won't know until I get one in two days, but it will either feel like a superpower - or be annoying. Or possibly first one, then the other.
- meheleventyone 3y ago
  This has been true since the earliest VR controllers of the current generation so there is plenty of evidence to check out right now!
- vatys 3y ago
  Virtually reaching for things far away might be interesting. I've alway been on the fence about VR, even for games, and never found any experiences to be compelling after a few minutes of fun. However, one thing that struck me about Half-Life Alyx was the "magic" feeling of the Gravity Gloves in the game. In the game you point and reach for something, flick back, and it flies into your hand. It's very satisfying and intuitive, and possibly my favorite aspect of the design of that game. I'm not sure if this would translate well out of a game design and into "real world" mixed reality, but it's an interesting thought.
- euroderf 3y ago
  IRL I can toss things in the corner of the room, or add them to a pile on the cabinet. My spatial memory will make a note. Soon I have teetering towers of klunk. This in accordance with Ringwald’s Law of Household Geometry. So hey why not in VR/AR too ? Then I can easily levitate an entire pile to check thru it, like the way I can click on a stack on my Mac.
- orangepanda 3y ago
  Kids in 2034 will flick at an old-timey light switch from half a room away, and be confused why it doesnt work
  - 3y ago
dragonelite 3y ago
Did they renamed AR/VR to spatial computing?
- blululu 3y ago
  This has been a push for a while. It is pretty hard to explain the nebulous distinctions between AR, VR, MR and XR without coming across as a self-important pedant. Spatial computing is a much clearer umbrella term since it describes the core feature that is unique to this family of technologies.
  - fragmede 3y ago
    I'll be the pedant then and say that how I understand it is that AR is just adding things, VR is when it replaces things entirely, MR is more than AR because there are digital and physical elements to interact with. XR, then, is an umbrella term that encompasses all of the above. Spacial computing vs XR as the phrase to use? Sure.
    - zyx321 3y ago
      How I understand it: VR is an entirely artificial environment. Augmented Reality is a mix between real world and artificial elements, in any proportion. Mixed Reality is Microsoft's term for AR. Spatial Computing is Apple's term for AR.
  - dragonelite 3y ago
    Aah this makes sense to put it under one umbrella of spatial computing.
  - deleted 3y ago
    [deleted]
mgaunard 3y ago
Touch interfaces are awful and a step backward.
- vagrantJin 3y ago
  Among the evil things my mind has cooked up, typing on touchscreen mobile devices is punishment.
dvh 3y ago
For me VR for office use doesn't survive the "timeline reversal thought experiment". Imagine that from the very beginning computers only had virtual reality headsets as the only interface. In the time of ENIAC it would be extremely huge grotesque steampunk helmet that you would put on but as the time goes by smaller and smaller headsets developed and eventually today we would arrive exactly where we are now with this Apple VR headset. And now, someone invents desktop PC monitor. It will be revolutionary. No longer you have to strap on headset and wear it for 8 hours when you're in the office. Instead of $4000 fragile gear you buy cheap $100 dollar flat panel with double the resolution. No motion sickness, no batteries, no cables around your neck. Everybody would switch and VR headsets would become niche product.
- arijun 3y ago
  That’s a bit silly of a thought experiment, because nothing survives it, since everything has its niche. If we had started with smartphones, computers coming along with their big screens and external input devices, people would be flooding to them. Even the timeline we have doesn’t survive—when smartphones came out it turned out people love having computing accessible from their pocket.
  - xanderlewis 3y ago
    > That’s a bit silly of a thought experiment, because nothing survives it I don’t think that’s true. There are developments that really do constitute genuine progress: for example, going from CRTs to LCDs. It’s hard to imagine a world populated by high-resolution, energy-efficient, colour-accurate flatscreens suddenly being replaced by the invention of a gigantic ugly box that performs worse on every available metric. …and yet CRTs still exist as a ‘niche’ product. There’s a whole corner of the internet where people admire and collect them. It may well be that ‘spatial computing’ or whatever you wish to call it is going to be a genuine step forward, but it’s also easy to imagine it might not be. And that’s not true for every technology.
    - theshackleford 3y ago
      > that performs worse on every available metric. Except motion. In which twenty year old monitors on my desk make everything put next to it look abysmal by comparison.
wolframhempel 3y ago
I'm a bit annoyed :-). We're building a platform (https://hivekit.io/ https://hivekit.io/) that lets you visualize, coordinate and automate operations in the physical world (on mines, construction sites, cities etc.). When I first started talking and writing about it, I described what we did as spatial computing because - well - its computing stuff in a spatial sense. I even went further, suggesting that the patterns that emerge from entities operating in a physical space resemble the mechanics of other "thinking systems" like Neural Nets. (see https://hivekit.io/blog/building-ai-without-a-neural-network/ https://hivekit.io/blog/building-ai-without-a-neural-network...) I felt, the term spatial computing was super applicable for that - and I still feel that way. But with the release of the vision pro, we had to surrender the term to Apple and go with the less pompous "workforce orchestration" instead.
- duped 3y ago
  Apple did not invent the term "spatial computing" to apply to XR (augmented/virtual/extended reality headsets). I've heard the term for at least the last ten years, personally. I believe Magic Leap first started using it. edit: wikipedia says it's been around since the 90s for VR
  - deleted 3y ago
    [deleted]
jwr 3y ago
Alas, our spatial computing journey seems to have taken many steps back. Our OSs treat icons on our desktops as theirs to do with as they please, rather than ours to keep where we want them. Window positions are forgotten, new windows are created pretty much at random anywhere the OS pleases. We can't arrange our files spatially. Instead, the OS talks to us through those dreaded "file open" dialogs, using abstractions of tables rather than spatial arrangements. We can't even arrange icons on our iOS home screens as we please — we have to stick to a predefined grid with predefined sizes and use a terrible interface to move them around. I do hope this will change in the future: our brains are wired for spatial memory and we should be making things easier for us by building software that is subservient to our needs, not the other way around.
- jayd16 3y ago
  It's not all bad. Windows finally fixed their window layout to monitor setup mappings. These VR headsets will try to keep things spatially anchored although the anchors still get lost fairly often.
vmfunction 3y ago
Apple had a file manager call x-space or something like that. Basically see your files in 3d space like game. It got killed by Steve of course at some point.
euroderf 3y ago
When last I read about the Spatial Finder, years ago, it did not compute. Now suddenly it does. Chalk it up to Windows-induced brain damage. Evolution: opposable thumbs => front panel loader => command line => GUI => (you are here) => spatial => true cyberpunk cyberspace. Tired: "Two dimensions ought to be enough for anybody."
kbf 3y ago
It’s worth mentioning that there are accessibility options that let you control the pointer using your index finger or wrist instead of your eyes and it looks pretty nice. I do think that Apple chose eye tracking in large part to combat fatigue and not require external hardware for basic operation. For longer sessions where you’re constantly interacting with apps, a mouse and keyboard is the best option just like on Mac.
duped 3y ago
What is so different about the AVP that sets it apart from the variety of headsets that have been on the market for years, besides the fact it's made by Apple?
- YoshiRulz 3y ago
  Passthrough resolution mainly. Also no controllers.
- RamRodification 3y ago
  The fact that it has an Apple user interface is a big one, I guess.
- phailhaus 3y ago
  Two things that set it apart: 1. R1 chip, which means that the spatial tracking basically never fails and is way more stable. Typical VR headsets will start lagging with the more CPU load they have, which causes disorientation and dizziness. 2. Eye tracking and gesture controls. There are cameras point at your eyes, down, and far to the sides. This means that no matter how you're sitting or where your arms are, it can see you "click" with your fingers. This level of seamlessness is necessary for the headset to feel effectively invisible. Typical VR headsets require you to deal with external controllers, which makes them more like consoles. Makes it more awkward to do simple things like check your phone or grab a drink. I honestly don't think it's going to take off because nobody has demonstrated a "killer app", but the AVP is substantially different from other headsets in the space.
  - jayd16 3y ago
    RE: 1. Do the pico headsets do this or something? Who doesn't have their spatial tracking process set as the highest priority? Are you confusing dropped frames with spatial tracking loss? Apple hasn't invented a technology to never drop frames so I expect once we hop into fully immersive Unity apps we'll have familiar stuttery moments.
    - 1123581321 3y ago
deleted 3y ago
[deleted]

Spatial Computing

88 points by ingve 3y ago

Animats 3y ago

[flagged]

elicash 3y ago
This isn't a review of the product. I think the public information is all you need to claim that Vision Pro asks you to look at objects and then use gestures like quickly putting your fingers together. In this post, he reflects on the evolution of spatial computing -- opposing claims that such a thing is a new idea -- and concludes by simply saying he "wonder[s]" if this interaction model will hold up as well as others. But the point is to put it in historical context, not to render a judgment. To me, the link back to his 2003 piece that talked about spatial interfaces was a really interesting way to view the AVP interaction model with a broader perspective. His voice is interesting here because he's written for decades about small interactions on the Mac and gone deeper into the details than maybe anybody.

mcbishop 3y ago

I think the eventual "direct manipulation" is to manipulate directly with the mind... no physical movement required.

blkhp19 3y ago
I could see there being serious issues with handling "impulse control." Imagine you see an ad, have a brief desire to interact with it, but tell yourself a split second later that you shouldn't. The time delay of using our physical body to carry out actions (movement, speech) that originate as thoughts acts as a very necessary filter. Imagine a world, even isolated to a spacial computing environment, where this filter didn't exist.
- yurishimo 3y ago
  I think there are two minds to this. One, with software, you could delay any action for a set amount of time as such to give your brain time to make a more concrete decision. Idk how long that delay needs to be, but I'm guessing it's less than 300ms. On the other hand, if the hardware is responsive enough, you can simply decide to close the program/ad/whatever another split second after that fleeting thought. The pessimist in me thinks that the first option is probably the best one given software optimization in the past two decades, but who knows.
  - dimask 3y ago
    > One, with software, you could delay any action for a set amount of time as such to give your brain time to make a more concrete decision. Is there a type of software that already does this? Because it is not like it could not be implemented right now, nor that it would not be useful right now for the exact same reasons. Of course it is completely against most corporations' interests, so not sure who would produce that in the first place.
    - jsjohnst 3y ago
      > Is there a type of software that already does this? Several email clients including Gmail have the ability to have a short delay from clicking “Send” till it actually does the send to allow you the ability to undo.
      - dimask 3y ago
        Yes but I assume that people do not usually get "addicted" to sending emails, and that feature seems more oriented towards making sense one did not forget sth or clicked send by mistake (has happened to me). What we talk about would be more relevant in social media, both in passively consuming and in participating more actively.
- eviks 3y ago
  Why wouldn't you simply add a filter if it's an issue?

trinsic2 3y ago

I don't know if the Visison Pro is like other 3d head sets, but I realized there is more of a cognitive load on the brain then just using a 2d screen. I think it has many applications, but I wouldn't want to be using it for long periods of time.

CoolestBeans 3y ago
You really put into words something I've experienced but couldn't articulate. Every time I've used a headset I've gotten not fatigued but just a general feeling of malaise and had to put it down and take a break. I would imagine with repetition you get used to it but yeah its definitely a factor. Although I think part of the bleh feeling is just having to subconsciously adapt to the imperfections of a headset. For example, you can't just glance at anything and expect to see it, you have to shift your head for some things. Or like the headset itself moving ever so slightly on the face and your eye moving out of the way of the center of the lens. It gets exhausting and you don't know you're doing it unless you're actively paying attention. I will say most of the advertising shows people interacting with 2D interfaces in 3D space so maybe this is how they're getting around it combined with just better build quality, better thought out straps, etc.
- trinsic2 3y ago
  Yea maybe you can get used to it. I have only used heat sets a few times. One thing I noticed was that My brain had two visual maps competing against each other. Reality and the virtual world. I sometimes found myself feeling the sensations from the virtual world from time to time while I was not using the head sets. It went away with time, but it was interesting anyway.

threeseed 3y ago

The whole point of the eye/finger mechanism is so that you can just pickup the headset at any time, watch a movie or play a game without needing to worry about finding and charging controllers. For doing proper work the keyboard/trackpad combination looks to be ideal.

realharo 3y ago
For navigating menus, even the original Quest's hand tracking, where you used your fingers to point at things, is good enough.
- crazygringo 3y ago
  The Quest 2's hand tracking is so bad as to be literally unusable for me. I just cannot get it to reliably recognize pinching. It's like only half the time, and sometimes I have to pinch like ten times in a row until success. Or the act of pinching also moves the hand off the item you're trying to click. And then certain things your on-screen hands just can't reach. Super unclear why. But I think something to do with trying to map hands close to you, to an interface button visually one or two meters away.

jojobas 3y ago

12 years after Oculus Rift SDK VR is still a gimmick that only ~10% of the relatively few owners use weekly. Calling it "spatial computing" won't change it.

ildjarn 3y ago
The second screen stuff has commercial applications.

muunbo 3y ago

One important aspect missing is tactical feedback. The mouse, keyboard, and touchscreen all provide that but Vision Pro doesn’t. We have evolved several nervous system sensors (touch, pressure, temperature) for this and it is just as “human” as spatial reasoning and hand manipulation of objects

meheleventyone 3y ago
That combined with a noisy signals from inferred controls with eye and hand tracking will frustrate a lot of people. Our current interfaces are extremely precise in comparison. I quickly narrowed down on VR experiences that provide a decent feeling of facsimile to real life being the most interesting and engaging. Beat Saber is a case in point here but for me it was combat flight sims using stick, throttle and pedals. Moving to gestures and eye tracking wrecks all of that. I also don’t know why the original article calls using a mouse indirect as if we aren’t masters at that as well. As well as a spatially aware species we are also a tooling using species. We are experts at leveraging our spatial reasoning to manipulate tools in the world to do things we otherwise couldn’t. A mouse movement in the world translating to moving a cursor on screen is a perfect fit.
threeseed 3y ago
There is tactical feedback on the Vision Pro for selecting, scrolling and moving. I suspect that we are going to see most apps centre around this finger/thumb motion.
- dvh 3y ago
  Do you and op mean tactile?
  - muunbo 3y ago
    Yes whoops tactile
eviks 3y ago
There is no tactile UI feedback in VPro, but then neither is it there in the mouse/keyboard. Otherwise when you touch your fingers against each other for some gesture, you feel them.

LeoPanthera 3y ago

There's one huge advantage to the "indirect manipulation" of the Vision Pro - you aren't limited to the space around you that you can reach with your hands. The Vision Pro allows you to manipulate things that are too far away to reach. I don't know if this will "feel" good or not, I won't know until I get one in two days, but it will either feel like a superpower - or be annoying. Or possibly first one, then the other.

meheleventyone 3y ago
This has been true since the earliest VR controllers of the current generation so there is plenty of evidence to check out right now!
vatys 3y ago
Virtually reaching for things far away might be interesting. I've alway been on the fence about VR, even for games, and never found any experiences to be compelling after a few minutes of fun. However, one thing that struck me about Half-Life Alyx was the "magic" feeling of the Gravity Gloves in the game. In the game you point and reach for something, flick back, and it flies into your hand. It's very satisfying and intuitive, and possibly my favorite aspect of the design of that game. I'm not sure if this would translate well out of a game design and into "real world" mixed reality, but it's an interesting thought.
euroderf 3y ago
IRL I can toss things in the corner of the room, or add them to a pile on the cabinet. My spatial memory will make a note. Soon I have teetering towers of klunk. This in accordance with Ringwald’s Law of Household Geometry. So hey why not in VR/AR too ? Then I can easily levitate an entire pile to check thru it, like the way I can click on a stack on my Mac.
orangepanda 3y ago
Kids in 2034 will flick at an old-timey light switch from half a room away, and be confused why it doesnt work
- 3y ago

dragonelite 3y ago

Did they renamed AR/VR to spatial computing?

blululu 3y ago
This has been a push for a while. It is pretty hard to explain the nebulous distinctions between AR, VR, MR and XR without coming across as a self-important pedant. Spatial computing is a much clearer umbrella term since it describes the core feature that is unique to this family of technologies.
- fragmede 3y ago
  I'll be the pedant then and say that how I understand it is that AR is just adding things, VR is when it replaces things entirely, MR is more than AR because there are digital and physical elements to interact with. XR, then, is an umbrella term that encompasses all of the above. Spacial computing vs XR as the phrase to use? Sure.
  - zyx321 3y ago
    How I understand it: VR is an entirely artificial environment. Augmented Reality is a mix between real world and artificial elements, in any proportion. Mixed Reality is Microsoft's term for AR. Spatial Computing is Apple's term for AR.
- dragonelite 3y ago
  Aah this makes sense to put it under one umbrella of spatial computing.
- deleted 3y ago
  [deleted]

mgaunard 3y ago

Touch interfaces are awful and a step backward.

vagrantJin 3y ago
Among the evil things my mind has cooked up, typing on touchscreen mobile devices is punishment.

dvh 3y ago

For me VR for office use doesn't survive the "timeline reversal thought experiment". Imagine that from the very beginning computers only had virtual reality headsets as the only interface. In the time of ENIAC it would be extremely huge grotesque steampunk helmet that you would put on but as the time goes by smaller and smaller headsets developed and eventually today we would arrive exactly where we are now with this Apple VR headset. And now, someone invents desktop PC monitor. It will be revolutionary. No longer you have to strap on headset and wear it for 8 hours when you're in the office. Instead of $4000 fragile gear you buy cheap $100 dollar flat panel with double the resolution. No motion sickness, no batteries, no cables around your neck. Everybody would switch and VR headsets would become niche product.

arijun 3y ago
That’s a bit silly of a thought experiment, because nothing survives it, since everything has its niche. If we had started with smartphones, computers coming along with their big screens and external input devices, people would be flooding to them. Even the timeline we have doesn’t survive—when smartphones came out it turned out people love having computing accessible from their pocket.
- xanderlewis 3y ago
  > That’s a bit silly of a thought experiment, because nothing survives it I don’t think that’s true. There are developments that really do constitute genuine progress: for example, going from CRTs to LCDs. It’s hard to imagine a world populated by high-resolution, energy-efficient, colour-accurate flatscreens suddenly being replaced by the invention of a gigantic ugly box that performs worse on every available metric. …and yet CRTs still exist as a ‘niche’ product. There’s a whole corner of the internet where people admire and collect them. It may well be that ‘spatial computing’ or whatever you wish to call it is going to be a genuine step forward, but it’s also easy to imagine it might not be. And that’s not true for every technology.
  - theshackleford 3y ago
    > that performs worse on every available metric. Except motion. In which twenty year old monitors on my desk make everything put next to it look abysmal by comparison.

wolframhempel 3y ago

I'm a bit annoyed :-). We're building a platform (https://hivekit.io/ https://hivekit.io/) that lets you visualize, coordinate and automate operations in the physical world (on mines, construction sites, cities etc.). When I first started talking and writing about it, I described what we did as spatial computing because - well - its computing stuff in a spatial sense. I even went further, suggesting that the patterns that emerge from entities operating in a physical space resemble the mechanics of other "thinking systems" like Neural Nets. (see https://hivekit.io/blog/building-ai-without-a-neural-network/ https://hivekit.io/blog/building-ai-without-a-neural-network...) I felt, the term spatial computing was super applicable for that - and I still feel that way. But with the release of the vision pro, we had to surrender the term to Apple and go with the less pompous "workforce orchestration" instead.

duped 3y ago
Apple did not invent the term "spatial computing" to apply to XR (augmented/virtual/extended reality headsets). I've heard the term for at least the last ten years, personally. I believe Magic Leap first started using it. edit: wikipedia says it's been around since the 90s for VR
- deleted 3y ago
  [deleted]

jwr 3y ago

Alas, our spatial computing journey seems to have taken many steps back. Our OSs treat icons on our desktops as theirs to do with as they please, rather than ours to keep where we want them. Window positions are forgotten, new windows are created pretty much at random anywhere the OS pleases. We can't arrange our files spatially. Instead, the OS talks to us through those dreaded "file open" dialogs, using abstractions of tables rather than spatial arrangements. We can't even arrange icons on our iOS home screens as we please — we have to stick to a predefined grid with predefined sizes and use a terrible interface to move them around. I do hope this will change in the future: our brains are wired for spatial memory and we should be making things easier for us by building software that is subservient to our needs, not the other way around.

jayd16 3y ago
It's not all bad. Windows finally fixed their window layout to monitor setup mappings. These VR headsets will try to keep things spatially anchored although the anchors still get lost fairly often.

vmfunction 3y ago

Apple had a file manager call x-space or something like that. Basically see your files in 3d space like game. It got killed by Steve of course at some point.

euroderf 3y ago

When last I read about the Spatial Finder, years ago, it did not compute. Now suddenly it does. Chalk it up to Windows-induced brain damage. Evolution: opposable thumbs => front panel loader => command line => GUI => (you are here) => spatial => true cyberpunk cyberspace. Tired: "Two dimensions ought to be enough for anybody."

kbf 3y ago

It’s worth mentioning that there are accessibility options that let you control the pointer using your index finger or wrist instead of your eyes and it looks pretty nice. I do think that Apple chose eye tracking in large part to combat fatigue and not require external hardware for basic operation. For longer sessions where you’re constantly interacting with apps, a mouse and keyboard is the best option just like on Mac.

duped 3y ago

What is so different about the AVP that sets it apart from the variety of headsets that have been on the market for years, besides the fact it's made by Apple?

YoshiRulz 3y ago
Passthrough resolution mainly. Also no controllers.
RamRodification 3y ago
The fact that it has an Apple user interface is a big one, I guess.
phailhaus 3y ago
Two things that set it apart: 1. R1 chip, which means that the spatial tracking basically never fails and is way more stable. Typical VR headsets will start lagging with the more CPU load they have, which causes disorientation and dizziness. 2. Eye tracking and gesture controls. There are cameras point at your eyes, down, and far to the sides. This means that no matter how you're sitting or where your arms are, it can see you "click" with your fingers. This level of seamlessness is necessary for the headset to feel effectively invisible. Typical VR headsets require you to deal with external controllers, which makes them more like consoles. Makes it more awkward to do simple things like check your phone or grab a drink. I honestly don't think it's going to take off because nobody has demonstrated a "killer app", but the AVP is substantially different from other headsets in the space.
- jayd16 3y ago
  RE: 1. Do the pico headsets do this or something? Who doesn't have their spatial tracking process set as the highest priority? Are you confusing dropped frames with spatial tracking loss? Apple hasn't invented a technology to never drop frames so I expect once we hop into fully immersive Unity apps we'll have familiar stuttery moments.
  - 1123581321 3y ago

deleted 3y ago

[deleted]