3 ms·

This problem specifically (3D reconstruction with representation fitting) is really an overfitting nightmare, they just adapted to it not really overcame it. No

• blovescoffee 2y ago
  The point of a Nerf is effectively overfitting a neural network to a scene anyways (I think they say this in the original NeRF paper - or somewhere similar).
• barfbagginus 2y ago
  I get the feeling that some abstract geometric/topological approaches will let us get under fitted general pretrained NERFs that rapidly specialize to a given context, let you combine separate contexts into a composite scene, and maybe let's you give behaviors to entities in the scene. At that point you're kind of trying to generically train over all possible scene graphs. But maybe some kind of geometric delocalization scheme lets you train on small fragments of larger scenes, transfer learning between scenes, and quickly represent and render generic scenes.