2 ms·

NeX: Real-Time View Synthesis with Neural Basis Expansion

• homarp 6y ago
  check real–time demos using shader: e.g. https://nex-mpi.github.io/viewer/viewer.html?scene=https://pureexe.github.io/crest/800 https://nex-mpi.github.io/viewer/viewer.html?scene=https://p... on mobile try https://nex-mpi.github.io/viewer/mobile.html?scene=https://pureexe.github.io/spaghetti/640 https://nex-mpi.github.io/viewer/mobile.html?scene=https://p...
  • wilde 6y ago
    Mobile demo doesn’t work on iOS for me, but the video is sweet.
    • pureexe 6y ago
      What's your phone model? It's work fine on iPhone X.
      • wilde 6y ago
        I’m trying in an iPhone 12 Pro Max on Safari.
  • dTal 6y ago
    Is it just me or does this not work on Firefox? Works okay for me on Chromium, but I do have a lot of Firefox addons. This happens a lot...
    • homarp 6y ago
      works for me on FF mobile and FF desktop
      • dTal 6y ago
        Thanks for the data point. It's probably an addon then.
  • billconan 6y ago
    I'm curious, for the input images, do I also need to provide camera's intrinsics and extrinsics?
    • pureexe 6y ago
      Yes, you need. This paper using COLMAP (https://colmap.github.io https://colmap.github.io) to get camera's intrinsic and extrinsic.
      • billconan 6y ago
        Thank you! I have tried colmap before, but the results seemed to be very noisy.
• vsskanth 6y ago
  Would be nice to get an ELI5 of this paper. So they take an actual picture input and re render it in 3D?
  • homarp 6y ago
    the paper defines nicely what they are trying to achieve: The problem comprises two intriguing challenges of how to construct a visual scene representation from only a sparse set of images and how to render such a representation from unseen perspectives.