4 ms·

Nvidia recently demoed a similar technique running in real time: https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-your-questions-answered/ https://www.nvid

Nvidia recently demoed a similar technique running in real time: https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-your-questions-answered/ https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-your-q...

jsheard 6y ago
More than demoed, they've shipped DLSS in quite a few games now. The 1.0 version was underwhelming but the 2.0 version works extremely well in practice. However Nvidia are treating DLSS as their secret sauce and not publishing any details, so Facebook's more open research is interesting even if it's not as refined yet.
- Scaevolus 6y ago
  This appears to be more accurate than DLSS according to Fig. 11 in the paper, and has the 16x mode as well as 4x.
  - dannyw 6y ago
    Meanwhile DLSS is real time and this takes 100ms a frame.
    - goldenkey 6y ago
      DLSS is possibly baked into the graphics cards. It is what the RT cores are for. Facebook is just releasing a POC. I doubt the code is handwritten CUDA optimized for performance.
      - gerardvivancos 6y ago
        On Nvidia cards the RT cores are the ones handling BVH traversal and ray-triangle intersection operations. The part of the hardware that is running the DLSS ML model are the tensor cores. But the algorithm and the model itself is not baked in, it is provided in the driver and/or game
  - bcatanzaro 6y ago
    That was DLSS 1.0 they compared with.
- cma 6y ago
  > However Nvidia are treating DLSS as their secret sauce and not publishing any details https://developer.nvidia.com/gtc/2020/video/s22698 https://developer.nvidia.com/gtc/2020/video/s22698
  - jsheard 6y ago
    There are no real details in that presentation, they explain what input data DLSS needs, and demonstrate the outputs it can produce, but gloss over how it actually gets there. From the inputs you can glean that DLSS is using temporal integration but that's hardly a new idea, the novel part is in how it performs the integration and Nvidia isn't sharing that.
    - Jasper_ 6y ago
      It's basically just a good TAA and the tensor cores are basically used as a poor man's Lanczos. The tensor cores are used for obfuscation, and to make sure it doesn't run on AMD. Very little about DLSS 2.0 is "DL".
      - bcatanzaro 6y ago
        This is inaccurate.
        david-gpu 6y ago
        Please be aware that the parent is Brian Catanzaro, VP of Applied Deep Learning Research at NVidia, who overviews the development of DLSS among many other things. If he says that the GP is inaccurate, trust him. Hi, Brian!
        deleted 6y ago
        [deleted]
    - deleted 6y ago
      [deleted]
    - cma 6y ago

jsheard 6y ago

More than demoed, they've shipped DLSS in quite a few games now. The 1.0 version was underwhelming but the 2.0 version works extremely well in practice. However Nvidia are treating DLSS as their secret sauce and not publishing any details, so Facebook's more open research is interesting even if it's not as refined yet.

Scaevolus 6y ago
This appears to be more accurate than DLSS according to Fig. 11 in the paper, and has the 16x mode as well as 4x.
- dannyw 6y ago
  Meanwhile DLSS is real time and this takes 100ms a frame.
  - goldenkey 6y ago
    DLSS is possibly baked into the graphics cards. It is what the RT cores are for. Facebook is just releasing a POC. I doubt the code is handwritten CUDA optimized for performance.
    - gerardvivancos 6y ago
      On Nvidia cards the RT cores are the ones handling BVH traversal and ray-triangle intersection operations. The part of the hardware that is running the DLSS ML model are the tensor cores. But the algorithm and the model itself is not baked in, it is provided in the driver and/or game
- bcatanzaro 6y ago
  That was DLSS 1.0 they compared with.
cma 6y ago
> However Nvidia are treating DLSS as their secret sauce and not publishing any details https://developer.nvidia.com/gtc/2020/video/s22698 https://developer.nvidia.com/gtc/2020/video/s22698
- jsheard 6y ago
  There are no real details in that presentation, they explain what input data DLSS needs, and demonstrate the outputs it can produce, but gloss over how it actually gets there. From the inputs you can glean that DLSS is using temporal integration but that's hardly a new idea, the novel part is in how it performs the integration and Nvidia isn't sharing that.
  - Jasper_ 6y ago
    It's basically just a good TAA and the tensor cores are basically used as a poor man's Lanczos. The tensor cores are used for obfuscation, and to make sure it doesn't run on AMD. Very little about DLSS 2.0 is "DL".
    - bcatanzaro 6y ago
      This is inaccurate.
      - david-gpu 6y ago
        Please be aware that the parent is Brian Catanzaro, VP of Applied Deep Learning Research at NVidia, who overviews the development of DLSS among many other things. If he says that the GP is inaccurate, trust him. Hi, Brian!
      - deleted 6y ago
        [deleted]
  - deleted 6y ago
    [deleted]
  - cma 6y ago