4 ms·

> Given how ambitious the hardware package is, the software paradigm is surprisingly conservative. I actually see this as a bit less surprising. After all, if

> Given how ambitious the hardware package is, the software paradigm is surprisingly conservative. I actually see this as a bit less surprising. After all, if you change the hardware in a big way, and you change the software in a big way, users will have a harder time adjusting to the new platform. Instead, they're making a big leap on the hardware side, keeping legacy apps and concepts, and then will presumably iterate to more 'native' experiences that were previously impossible/unimaginable/unintuitive.

stephc_int13 3y ago
Text is still a large part of the interfaces we use. We are all highly trained to read text, it seems basic but it is in practice quite abstract. Text is still best read on a flat surface. The great innovation I can see with this new Apple device is eye tracking, they have not invented it, but they might have perfected it enough to be useable. Eyes could be better than a mouse.
- roblh 3y ago
  Yeah, if their eye tracking plus foveated rendering works as advertised, it could be a huge step forward. I'm really curious how responsive the gesture controls will be too, it was really cool seeing the finger pinches(?) being used as an input method. I wonder if it's specifically designed just for that thing or if it's all built out to track any arbitrary hand gesture accurately. And I wonder what the language/api for describing hand gestures would even look like.
  - MBCook 3y ago
    I don’t doubt them. The PSVR2 has both and it supposedly works very well. That lacks other features of course and must be tethered to a PlayStation 5. But eye tracking + foveated rendering seems like it’s going to become table stakes in the next few years.
- Gigachad 3y ago
  Eye tracking is almost certainly more accurate and faster. To the point where we make it an entire game to see who can who can move the mouse to what their eyes are already looking at fastest, in the form of shooter games.
  - gnicholas 3y ago
    Interesting point — if you no longer need to use a joystick to aim your weapon, how will controllers evolve? Will the second joystick be used for some other function, or will it be replaced by a different type of input method? It would be funny if controllers evolved to be more like the single-joystick models that we had decades ago, with the joystick on the left and rows of buttons on the right. History doesn't repeat itself, but perhaps it'll rhyme?
    - Fire-Dragon-DoL 3y ago
      One joystick has to exist since there are many videogames where the character is not in focus (barely), thinking of hack and slash with top down camera (the recent diablo 4),the majority of the focus is on where the attacks are going. In top down bullet hell shooters the player had to aim and shoot in one direction as it walks in another (potentially opposite), so one stick is still needed
      - gnicholas 3y ago
        Agreed — I'm thinking we'd have just one joystick, to control movement. The second joystick could evolve into some new interface, or devolve into a row of buttons.
        cubefox 3y ago
        PSVR2 already has eye tracking. And unlike the Apple Vision it also has controllers with a stick. Perhaps there are already such games which let you aim with your eyes (assuming you are shooting at something), while you move around with one stick, and the second stick isn't used at all.
gutnor 3y ago
That was repeated a bunch of time during the keynote: "familiar"
balaji1 3y ago
In the demo, I was hoping to see some app/screen/display anchored to certain walls or being fixed in a 3D spot. That way I can walk to a place to see that "screen".
- endisneigh 3y ago
  Isn’t that an intractable problem without LiDAR? I suppose the naive solution would be to fix the screens in spots as you suggest as opposed to pinning onto real life locations. edit: ah, right the vision pro does have lidar. I look forward to seeing this pinning if it's implemented. I'm still skeptical it would work well - I've used ARKit and it's not really that accurate when you're moving around.
  - fauntle 3y ago
    It should be relatively simple with a QR code or similar physical marker in the real world.
    - endisneigh 3y ago
      With yeah I agree. Without though it seems difficult
      - balaji1 3y ago
        why do you guys say this? Amazon's "View in your room" feature does a decent job of placing a furniture in AR. We can even walk around/towards it. And that tech is just Apple ARKit right?
        endisneigh 3y ago
        I don’t think it’s that good. “Decent” is accurate
        balaji1 3y ago

stephc_int13 3y ago

Text is still a large part of the interfaces we use. We are all highly trained to read text, it seems basic but it is in practice quite abstract. Text is still best read on a flat surface. The great innovation I can see with this new Apple device is eye tracking, they have not invented it, but they might have perfected it enough to be useable. Eyes could be better than a mouse.

roblh 3y ago
Yeah, if their eye tracking plus foveated rendering works as advertised, it could be a huge step forward. I'm really curious how responsive the gesture controls will be too, it was really cool seeing the finger pinches(?) being used as an input method. I wonder if it's specifically designed just for that thing or if it's all built out to track any arbitrary hand gesture accurately. And I wonder what the language/api for describing hand gestures would even look like.
- MBCook 3y ago
  I don’t doubt them. The PSVR2 has both and it supposedly works very well. That lacks other features of course and must be tethered to a PlayStation 5. But eye tracking + foveated rendering seems like it’s going to become table stakes in the next few years.
Gigachad 3y ago
Eye tracking is almost certainly more accurate and faster. To the point where we make it an entire game to see who can who can move the mouse to what their eyes are already looking at fastest, in the form of shooter games.
- gnicholas 3y ago
  Interesting point — if you no longer need to use a joystick to aim your weapon, how will controllers evolve? Will the second joystick be used for some other function, or will it be replaced by a different type of input method? It would be funny if controllers evolved to be more like the single-joystick models that we had decades ago, with the joystick on the left and rows of buttons on the right. History doesn't repeat itself, but perhaps it'll rhyme?
  - Fire-Dragon-DoL 3y ago
    One joystick has to exist since there are many videogames where the character is not in focus (barely), thinking of hack and slash with top down camera (the recent diablo 4),the majority of the focus is on where the attacks are going. In top down bullet hell shooters the player had to aim and shoot in one direction as it walks in another (potentially opposite), so one stick is still needed
    - gnicholas 3y ago
      Agreed — I'm thinking we'd have just one joystick, to control movement. The second joystick could evolve into some new interface, or devolve into a row of buttons.
      - cubefox 3y ago
        PSVR2 already has eye tracking. And unlike the Apple Vision it also has controllers with a stick. Perhaps there are already such games which let you aim with your eyes (assuming you are shooting at something), while you move around with one stick, and the second stick isn't used at all.

gutnor 3y ago

That was repeated a bunch of time during the keynote: "familiar"

balaji1 3y ago

In the demo, I was hoping to see some app/screen/display anchored to certain walls or being fixed in a 3D spot. That way I can walk to a place to see that "screen".

endisneigh 3y ago
Isn’t that an intractable problem without LiDAR? I suppose the naive solution would be to fix the screens in spots as you suggest as opposed to pinning onto real life locations. edit: ah, right the vision pro does have lidar. I look forward to seeing this pinning if it's implemented. I'm still skeptical it would work well - I've used ARKit and it's not really that accurate when you're moving around.
- fauntle 3y ago
  It should be relatively simple with a QR code or similar physical marker in the real world.
  - endisneigh 3y ago
    With yeah I agree. Without though it seems difficult
    - balaji1 3y ago
      why do you guys say this? Amazon's "View in your room" feature does a decent job of placing a furniture in AR. We can even walk around/towards it. And that tech is just Apple ARKit right?
      - endisneigh 3y ago
        I don’t think it’s that good. “Decent” is accurate
        balaji1 3y ago