4 ms·

I was hoping someone had found a better way than radiance fields to generate actual 3D models. This is creating 360 panoramic images, which are not "3D" unless

I was hoping someone had found a better way than radiance fields to generate actual 3D models. This is creating 360 panoramic images, which are not "3D" unless I'm missing something. Still impressive tech, though.

dorkwood 3y ago
It looks like the final image is rendered as a cubemap in the shader. Cubes are technically 3D.
- sidewndr46 3y ago
  is there a way to export it to geometry with textures?
  - jdiff 3y ago
    If a cube or sphere are acceptable geometry, sure.
all2 3y ago
It is called "skybox" AI, a reference to sky boxes from video games.
mefarza123 3y ago
I found some papers which propose alternative methods (source: https://MirrorThink.ai https://MirrorThink.ai): 1. Point-NeRF: Point-based Neural Radiance Fields - 2022: This paper presents Point-NeRF, a localized neural representation that combines volumetric radiance fields with point clouds to model complex local scene geometry and appearance. It achieves better rendering quality than NeRF and is more efficient in reconstructing complex and large-scale scenes. 2. TensoRF: Tensorial Radiance Fields - 2022: TensoRF proposes a tensorial radiance field representation that can achieve fast reconstruction and high rendering quality. It is significantly faster than NeRF and many previous methods. 3. GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields - 2022: GazeNeRF incorporates 3D awareness with gaze redirection by applying a rotation matrix to the disentangled eyeball feature maps. It represents a static scene with multi-layer perceptrons and maps the 3D positions and viewing directions to a density and radiance for generating novel views with volume rendering. [1] https://arxiv.org/abs/2212.04823 https://arxiv.org/abs/2212.04823 [2] https://arxiv.org/abs/2203.09517 https://arxiv.org/abs/2203.09517 [3] https://arxiv.org/abs/2201.08845 https://arxiv.org/abs/2201.08845
- underanalyzer 3y ago
  @dang this account appears to be low effort ai generated spam presumably to promote MirrorThink.ai (look at the past comments) Regardless this answer does not responded to the parent comment's question at all since all of these papers are about radiance fields.
com2kid 3y ago
If you check out their Discord they have tools in (closed I think) beta that generative full 3d scenes. Lots of really cool demos get posted their daily. I'd actually say that as someone using it purely for panorama generation that I'm in the minority of use cases.
jahewson 3y ago
Check out https://nerf.studio https://nerf.studio it can do some mind-bending stuff.
- underanalyzer 3y ago
  while nerf.studio is impressive, the parent comment is asking about radiance field free methods. NeRF stands for Neural Radiance Fields and all of the algorithms in that repo use radiance fields
gumballindie 3y ago
I do it with heightmaps. It can generate human faces, rocks, planets, terrains, all at high detail. There is no need for attempting to generate 3d models for everything, when you can create “blueprints”.
anonzzzies 3y ago
Can I make these my office in VR? On the Quest 2?

dorkwood 3y ago

It looks like the final image is rendered as a cubemap in the shader. Cubes are technically 3D.

sidewndr46 3y ago
is there a way to export it to geometry with textures?
- jdiff 3y ago
  If a cube or sphere are acceptable geometry, sure.

all2 3y ago

It is called "skybox" AI, a reference to sky boxes from video games.

mefarza123 3y ago

I found some papers which propose alternative methods (source: https://MirrorThink.ai https://MirrorThink.ai): 1. Point-NeRF: Point-based Neural Radiance Fields - 2022: This paper presents Point-NeRF, a localized neural representation that combines volumetric radiance fields with point clouds to model complex local scene geometry and appearance. It achieves better rendering quality than NeRF and is more efficient in reconstructing complex and large-scale scenes. 2. TensoRF: Tensorial Radiance Fields - 2022: TensoRF proposes a tensorial radiance field representation that can achieve fast reconstruction and high rendering quality. It is significantly faster than NeRF and many previous methods. 3. GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields - 2022: GazeNeRF incorporates 3D awareness with gaze redirection by applying a rotation matrix to the disentangled eyeball feature maps. It represents a static scene with multi-layer perceptrons and maps the 3D positions and viewing directions to a density and radiance for generating novel views with volume rendering. [1] https://arxiv.org/abs/2212.04823 https://arxiv.org/abs/2212.04823 [2] https://arxiv.org/abs/2203.09517 https://arxiv.org/abs/2203.09517 [3] https://arxiv.org/abs/2201.08845 https://arxiv.org/abs/2201.08845

underanalyzer 3y ago
@dang this account appears to be low effort ai generated spam presumably to promote MirrorThink.ai (look at the past comments) Regardless this answer does not responded to the parent comment's question at all since all of these papers are about radiance fields.

com2kid 3y ago

If you check out their Discord they have tools in (closed I think) beta that generative full 3d scenes. Lots of really cool demos get posted their daily. I'd actually say that as someone using it purely for panorama generation that I'm in the minority of use cases.

jahewson 3y ago

Check out https://nerf.studio https://nerf.studio it can do some mind-bending stuff.

underanalyzer 3y ago
while nerf.studio is impressive, the parent comment is asking about radiance field free methods. NeRF stands for Neural Radiance Fields and all of the algorithms in that repo use radiance fields

gumballindie 3y ago

I do it with heightmaps. It can generate human faces, rocks, planets, terrains, all at high detail. There is no need for attempting to generate 3d models for everything, when you can create “blueprints”.

anonzzzies 3y ago

Can I make these my office in VR? On the Quest 2?