3 ms·

Forgive me if I have this all wrong, but in summary it seems to be that they have created a faster algorithm for creating a 3D (built of voxels, not polygons) f

• h0l0cube 5y ago
  No, AFAICT it's actually building a representation of a more detailed ray-traced 3D geometry in a way that can be rendered real time from any angle and with realistic lighting
  • ryandamm 5y ago
    Per the paper it's not quite real time (15 fps), and they suggest converting to a different representation (PlenOctrees) for real time. But yes, it's far more realistic than your simple mesh-and-texture; the video shows it handles reflections and transparency. When NeRF came out (~2020?) it was a major step forward in light field quality and this technique appears to maintain that quality.
• aidenn0 5y ago
  It seems to be a faster way of calculating differentiable volumetric geometry from a scene (whether the input is computer-generated or captured from the real world). I didn't get it at all until I explored the linked NeRF site first.
• ryandamm 5y ago
  The actual representation is using voxels to index a spherical harmonic coding of scene detail (I think), and that includes transparency so the novel view synthesis accretes light along the ray length. This lets it represent transparency and other lighting effects that aren't possible with simple photogrammetry.