3 ms·

> a dynamic medium we can see, feel and manipulate I wonder if this is a "pick 2" situation. Touchscreen: see and sorta manipulate Orion: manipulate (in only

> a dynamic medium we can see, feel and manipulate I wonder if this is a "pick 2" situation. Touchscreen: see and sorta manipulate Orion: manipulate (in only the weak sense that it uses more than one finger) Braille display, haptic glove/suit: feel and see (redundantly?) In my touchscreen-biased mind, I can't imagine a technology that could do all three of these, which I would want to use regularly or carry around, or wear for hours at a time. The touchscreen, combining the "see" with at least a tiny bit of the "manipulate", is actually an amazing step, but it may be a dead end. I've seen research into things like tactile screens, with adjustable surface height. But the benefit it gives is evidently not worth the cost in development, manufacturing, or complexity.

bbor 2y ago
Thanks for taking the time, really thought provoking… Will definitely be kicking that around in my head. No counterpoints. I was going to correct you that Orion is just a baby step towards Minority Report holograms (aka plain ol’ non-tangible holograms), and that reminded me: the famous opening scene had lots more than holograms! Specifically, they had physical objects (harddrives, knobs, spheres, etc) that didn’t seem to have much electronics actually in them, but that were tracked and responded-to by the computing system in a dynamic way. For example, easily passing data between the hologram and a little ball that you can easily move to another display, give to someone else, etc. in a completely seamless (read: AI-managed) way. That might be my biggest hope for the future, while we’re waiting on tactile gloves. This kind of thing: https://www.behance.net/gallery/105147921/Apple-x-Procreate-Concept https://www.behance.net/gallery/105147921/Apple-x-Procreate-...
- alanbernstein 2y ago
  Counterpoint to myself: Accelerometer-based inputs might demonstrate that I'm wrong. In the Zelda games on the Switch, you aim the bow and arrow with motion controls. This may be the smoothest, most natural interface I can think of; changing back to joystick controls feels really bad. The input is 2DOF manipulation, and the feedback is primarily seen on the screen. There is a small amount of "feel" feedback inherent to the physical motion of the controller. Another example on the Switch is a "labyrinth" balance minigame in Kirby. I recall early iPhone games exploring this UI, but it doesn't seem to have developed into anything except games and levelling utility apps.

bbor 2y ago

Thanks for taking the time, really thought provoking… Will definitely be kicking that around in my head. No counterpoints. I was going to correct you that Orion is just a baby step towards Minority Report holograms (aka plain ol’ non-tangible holograms), and that reminded me: the famous opening scene had lots more than holograms! Specifically, they had physical objects (harddrives, knobs, spheres, etc) that didn’t seem to have much electronics actually in them, but that were tracked and responded-to by the computing system in a dynamic way. For example, easily passing data between the hologram and a little ball that you can easily move to another display, give to someone else, etc. in a completely seamless (read: AI-managed) way. That might be my biggest hope for the future, while we’re waiting on tactile gloves. This kind of thing: https://www.behance.net/gallery/105147921/Apple-x-Procreate-Concept https://www.behance.net/gallery/105147921/Apple-x-Procreate-...

alanbernstein 2y ago
Counterpoint to myself: Accelerometer-based inputs might demonstrate that I'm wrong. In the Zelda games on the Switch, you aim the bow and arrow with motion controls. This may be the smoothest, most natural interface I can think of; changing back to joystick controls feels really bad. The input is 2DOF manipulation, and the feedback is primarily seen on the screen. There is a small amount of "feel" feedback inherent to the physical motion of the controller. Another example on the Switch is a "labyrinth" balance minigame in Kirby. I recall early iPhone games exploring this UI, but it doesn't seem to have developed into anything except games and levelling utility apps.