4 ms·

F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories

78 points by smusamashah 4y ago

m3kw9 4y ago
Google streets using this gonna be lit
- aaroninsf 4y ago
  That... is an excellent observation.
- sorenjan 4y ago
  They're already there, although it's probably too computationally costly to do at scale. https://waymo.com/research/block-nerf/ https://waymo.com/research/block-nerf/
Lucent 4y ago
How has this not yet been deployed by a startup to unseat three-quarter billion market cap Matterport?
- fudged71 4y ago
  Luma Labs seems to be doing very well, they just raised some big funding
  - nobbis 4y ago
    And Matterport will never see them coming, as their employees are banned from using Luma: Competitors: No employee, independent contractor, agent, or affiliate of any competing 3-D capture company is permitted to view, access, or use any portion of the Service without express written permission from Luma AI. By viewing, using, or accessing the Service, you represent and warrant that you are not a competitor of Luma AI or any of its affiliates, or acting on behalf of a competitor of Luma AI in using or accessing the Service. https://lumalabs.ai/legal/tos https://lumalabs.ai/legal/tos (Disclaimer: another banned competitor)
    - mepian 4y ago
      Is this even legal?
      - nobbis 4y ago
        IANAL but I assume so. "Employee of a competing company" (whatever that means) isn't a protected class.
    - pierrebai 4y ago
      IANAL, but this seems easily circumvented by setting up an independent entity. (It's not an affiliate if it's not owned by the competitor.)
fudged71 4y ago
What a time to be alive!
kleiba 4y ago
I don't understand what exactly I'm looking at, since it's not my area. What is going on here?
- riotnrrd 4y ago
  Neural radiance fields (NeRFs) is a technique to create models of complex 3d geometry from a set of photo/camera pose pairs. The way it usually works is that the 3d geometry you're interested in (a car, a tree, etc.) exists within a static, bounded space (e.g. a unit cube). This research changes that requirement, allowing you to create larger spaces without the memory and computational drawbacks of "just making the bounded space bigger."
peteforde 4y ago
This seems like it could have exciting implications for VR. Even after many years, one of my favourite things to do in VR is Google Earth. Yet, as a developer, it's a frustratingly closed platform. I understand that they don't want me to put steampunk zeppelins into the world, but I so very want that.
- azinman2 4y ago
  What vr platform supports it? I’d love to have some kind of remote robot that live streams to me as it goes around somewhere remote. Yes this has many obvious problems, but to be able to be in Tokyo for a few hours, hear the environment and direct what I want to see would be incredibly exciting to me.
  - peteforde 4y ago
    I primarily work in Unity, but I'm not sure if that answers your question?

78 points by smusamashah 4y ago

m3kw9 4y ago

Google streets using this gonna be lit

aaroninsf 4y ago
That... is an excellent observation.
sorenjan 4y ago
They're already there, although it's probably too computationally costly to do at scale. https://waymo.com/research/block-nerf/ https://waymo.com/research/block-nerf/

Lucent 4y ago

How has this not yet been deployed by a startup to unseat three-quarter billion market cap Matterport?

fudged71 4y ago
Luma Labs seems to be doing very well, they just raised some big funding
- nobbis 4y ago
  And Matterport will never see them coming, as their employees are banned from using Luma: Competitors: No employee, independent contractor, agent, or affiliate of any competing 3-D capture company is permitted to view, access, or use any portion of the Service without express written permission from Luma AI. By viewing, using, or accessing the Service, you represent and warrant that you are not a competitor of Luma AI or any of its affiliates, or acting on behalf of a competitor of Luma AI in using or accessing the Service. https://lumalabs.ai/legal/tos https://lumalabs.ai/legal/tos (Disclaimer: another banned competitor)
  - mepian 4y ago
    Is this even legal?
    - nobbis 4y ago
      IANAL but I assume so. "Employee of a competing company" (whatever that means) isn't a protected class.
  - pierrebai 4y ago
    IANAL, but this seems easily circumvented by setting up an independent entity. (It's not an affiliate if it's not owned by the competitor.)

fudged71 4y ago

What a time to be alive!

kleiba 4y ago

I don't understand what exactly I'm looking at, since it's not my area. What is going on here?

riotnrrd 4y ago
Neural radiance fields (NeRFs) is a technique to create models of complex 3d geometry from a set of photo/camera pose pairs. The way it usually works is that the 3d geometry you're interested in (a car, a tree, etc.) exists within a static, bounded space (e.g. a unit cube). This research changes that requirement, allowing you to create larger spaces without the memory and computational drawbacks of "just making the bounded space bigger."

peteforde 4y ago

This seems like it could have exciting implications for VR. Even after many years, one of my favourite things to do in VR is Google Earth. Yet, as a developer, it's a frustratingly closed platform. I understand that they don't want me to put steampunk zeppelins into the world, but I so very want that.

azinman2 4y ago
What vr platform supports it? I’d love to have some kind of remote robot that live streams to me as it goes around somewhere remote. Yes this has many obvious problems, but to be able to be in Tokyo for a few hours, hear the environment and direct what I want to see would be incredibly exciting to me.
- peteforde 4y ago
  I primarily work in Unity, but I'm not sure if that answers your question?