3 ms·

It does use the GPU, but this isn't really for production use (at all). It's a research renderer and its key functionality is reversible rendering—going from a

It does use the GPU, but this isn't really for production use (at all). It's a research renderer and its key functionality is reversible rendering—going from an image to the scene parameters that would create that image. The purpose of this kind of renderer is to develop research ideas that will eventually make it into a production renderer someday…

solarmist 4y ago
Thank you. I didn’t have a clue why I should care about this.
IIAOPSW 4y ago
Unless it simply encodes scene information as imperceptible color gradients, this is impossible as a render necessarily projects from 3d to 2d.
- throw149102 4y ago
  It's not possible to do uniquely, i.e. producing the unique scene that produced the image, but it's possible to produce some scene that would produce that image.
  - yababa_y 4y ago
    If it's possible to model those diffractive materials they use for those diffractive neural networks, it would be entertaining to do an inverse rendering on a digit recognition and see what if anything it can do.
  - IIAOPSW 4y ago
    It is possible to produce infinite scenes that would produce the image, including the scene which contains the render itself as a flat object viewed through a camera. Sampling from this infinite set of possibilities isn't useful unless you introduce a ton of fragile assumptions about what you could be looking at to begin with, in which case you kind of already knew what was in the scene.
    - erichocean 4y ago
      > in which case you kind of already knew what was in the scene It's almost like I wrote "scene parameters" for a reason. More info here: https://blog.qarnot.com/an-overview-of-differentiable-rendering/ https://blog.qarnot.com/an-overview-of-differentiable-render... > While these techniques came closer and closer to photorealism, another question arose: what if instead of going from a 3D scene to a 2D image (rendering), we went from a 2D image to a 3D scene? As you may imagine, reconstructing 3D scenes from 2D information is quite complex, but there have been many advances in the last few years. This area of study is called inverse graphics.
  - taylorius 4y ago
    This is true, though machine learning models will learn typical scene structures, alongside the rendering parameters. It is also common to use more than one source image (from a different viewpoint, a bit like photogrammetry).
- erichocean 4y ago
  Here's an example of it being done (watch the video): http://rgl.epfl.ch/publications/Vicini2022SDF http://rgl.epfl.ch/publications/Vicini2022SDF

solarmist 4y ago

Thank you. I didn’t have a clue why I should care about this.

IIAOPSW 4y ago

Unless it simply encodes scene information as imperceptible color gradients, this is impossible as a render necessarily projects from 3d to 2d.

throw149102 4y ago
It's not possible to do uniquely, i.e. producing the unique scene that produced the image, but it's possible to produce some scene that would produce that image.
- yababa_y 4y ago
  If it's possible to model those diffractive materials they use for those diffractive neural networks, it would be entertaining to do an inverse rendering on a digit recognition and see what if anything it can do.
- IIAOPSW 4y ago
  It is possible to produce infinite scenes that would produce the image, including the scene which contains the render itself as a flat object viewed through a camera. Sampling from this infinite set of possibilities isn't useful unless you introduce a ton of fragile assumptions about what you could be looking at to begin with, in which case you kind of already knew what was in the scene.
  - erichocean 4y ago
    > in which case you kind of already knew what was in the scene It's almost like I wrote "scene parameters" for a reason. More info here: https://blog.qarnot.com/an-overview-of-differentiable-rendering/ https://blog.qarnot.com/an-overview-of-differentiable-render... > While these techniques came closer and closer to photorealism, another question arose: what if instead of going from a 3D scene to a 2D image (rendering), we went from a 2D image to a 3D scene? As you may imagine, reconstructing 3D scenes from 2D information is quite complex, but there have been many advances in the last few years. This area of study is called inverse graphics.
- taylorius 4y ago
  This is true, though machine learning models will learn typical scene structures, alongside the rendering parameters. It is also common to use more than one source image (from a different viewpoint, a bit like photogrammetry).
erichocean 4y ago
Here's an example of it being done (watch the video): http://rgl.epfl.ch/publications/Vicini2022SDF http://rgl.epfl.ch/publications/Vicini2022SDF