3 ms·

I wonder if we'll now see "VR was a bad bet", when everyone is turning into LLMs and hoping Apples comes up with something on their own.

Despegar 4y ago
Apple will likely make all the money from it in the end anyway.
fullshark 4y ago
Maybe for FB, a web service, but Apple's competitive advantage is hardware/surfaces. Can't imagine they think betting on the headset is a bad move just from a risk management perspective in case it takes off.
adfm 4y ago
What if LLMs are the killer app? https://lukashoel.github.io/text-to-room/ https://lukashoel.github.io/text-to-room/
- bastawhiz 4y ago
  I'm unconvinced that actually making the content is the problem. We had SketchUp fifteen years ago and that made it stupid easy to make some really killer 3d content. I don't think being able to use natural language removes the barriers to it taking off. The real problem isn't the shapes (there's plenty of free meshes out there), it's making them interactive, which is a complicated problem that extends well beyond the capabilities of our current generation of LLMs. Just look at Roblox: it's successful because you can make the world do stuff. But we can be pretty sure that just making VR/AR Roblox doesn't make a killer app. The challenge that a killer app for VR/AR needs to overcome is being more than a glorified art gallery.
  - adfm 4y ago
    Oh, you want interactively? https://instruct-nerf2nerf.github.io/ https://instruct-nerf2nerf.github.io/
    - bastawhiz 4y ago
      That's not really interactive. A nerf of a basketball doesn't know how to bounce. Giving objects physics, texture, compressability, the ability to hinge or bend, etc. Is all well beyond what models today can do.
      - adfm 4y ago
        It's as interactive as that key press or mouse click you implemented in your reply. NeRFs are an intermediary step. So is motion capture and physical simulation, which we already know how to do. Folks on this side of the uncanny valley will nitpick everything rendered while everyone else is on the other side talking about the photorealism being generated.
        bastawhiz 4y ago
        Nobody goes to VR because of how easy it is to have stuff. They want VR to do stuff with the stuff.
- kitsunesoba 4y ago
  Put this in an MR/VR headset and hook it up to voice recognition and you've got what's probably the closest thing to a Star Trek holodeck as is possible with current tech.
j2bax 4y ago
Seems like a very subtle lightweight glasses type product would pair nicely with LLM.
scarface74 4y ago
1. It’s not like the people working on VR headsets are the same people who would be working on LLMs. 2. I think Apple has enough money to fund both initiatives to be alright 3. The unit economics of LLM products are still not proven and even when it is, any hardware product will more than likely have higher margins. Do you think people are going to give up the iOS ecosystem for Android based on an improved voice assistant?

Despegar 4y ago

Apple will likely make all the money from it in the end anyway.

fullshark 4y ago

Maybe for FB, a web service, but Apple's competitive advantage is hardware/surfaces. Can't imagine they think betting on the headset is a bad move just from a risk management perspective in case it takes off.

adfm 4y ago

What if LLMs are the killer app? https://lukashoel.github.io/text-to-room/ https://lukashoel.github.io/text-to-room/

bastawhiz 4y ago
I'm unconvinced that actually making the content is the problem. We had SketchUp fifteen years ago and that made it stupid easy to make some really killer 3d content. I don't think being able to use natural language removes the barriers to it taking off. The real problem isn't the shapes (there's plenty of free meshes out there), it's making them interactive, which is a complicated problem that extends well beyond the capabilities of our current generation of LLMs. Just look at Roblox: it's successful because you can make the world do stuff. But we can be pretty sure that just making VR/AR Roblox doesn't make a killer app. The challenge that a killer app for VR/AR needs to overcome is being more than a glorified art gallery.
- adfm 4y ago
  Oh, you want interactively? https://instruct-nerf2nerf.github.io/ https://instruct-nerf2nerf.github.io/
  - bastawhiz 4y ago
    That's not really interactive. A nerf of a basketball doesn't know how to bounce. Giving objects physics, texture, compressability, the ability to hinge or bend, etc. Is all well beyond what models today can do.
    - adfm 4y ago
      It's as interactive as that key press or mouse click you implemented in your reply. NeRFs are an intermediary step. So is motion capture and physical simulation, which we already know how to do. Folks on this side of the uncanny valley will nitpick everything rendered while everyone else is on the other side talking about the photorealism being generated.
      - bastawhiz 4y ago
        Nobody goes to VR because of how easy it is to have stuff. They want VR to do stuff with the stuff.
kitsunesoba 4y ago
Put this in an MR/VR headset and hook it up to voice recognition and you've got what's probably the closest thing to a Star Trek holodeck as is possible with current tech.

j2bax 4y ago

Seems like a very subtle lightweight glasses type product would pair nicely with LLM.

scarface74 4y ago

1. It’s not like the people working on VR headsets are the same people who would be working on LLMs. 2. I think Apple has enough money to fund both initiatives to be alright 3. The unit economics of LLM products are still not proven and even when it is, any hardware product will more than likely have higher margins. Do you think people are going to give up the iOS ecosystem for Android based on an improved voice assistant?