6 ms·
Gaussian explosion
- spsesk117 3y agoI am a complete layman in the world of complex computer graphics programming and research, but I have an interest in it as someone who enjoys playing computer games. I really enjoyed this succinct YouTube video on the topic, for those interested in a primer: https://youtu.be/HVv_IQKlafQ?si=y9gdS-1UkmdTX2Ik https://youtu.be/HVv_IQKlafQ?si=y9gdS-1UkmdTX2Ik
- SubiculumCode 3y agoI was just going to ask for something like this. thank you.
- simonw 3y agoThat was great, thank you.
- wellthisisgreat 3y agoI rewatched the video several times just for the humor. “I am what now?” “Everyone calls it that” Anyone knows other videos / channels that combine info and dry quality humor?
- rjbwork 3y ago>Anyone knows other videos / channels that combine info and dry quality humor? Check out Patrick Boyle on Finance on YouTube. Informative finance news/mini-documentaries with dry British wit. https://www.youtube.com/c/PatrickBoyleOnFinance https://www.youtube.com/c/PatrickBoyleOnFinance
- smusamashah 3y agoHere is another one by the same guy https://x.com/dylan_ebert_/status/1726023059008573761 https://x.com/dylan_ebert_/status/1726023059008573761
- magicalhippo 3y agoI always end up laughing while watching SuperfastMatt[1]. [1]: https://www.youtube.com/@SuperfastMatt https://www.youtube.com/@SuperfastMatt
- retsibsi 3y agoNot sure how well it fits what you're looking for, but if you're not already aware of tom7/suckerpinch, you might get a kick out of some of his videos -- e.g. https://www.youtube.com/watch?v=5TFDG-y-EHs https://www.youtube.com/watch?v=5TFDG-y-EHs
- slalomskiing 3y agoCan someone explain why there’s so much interest in these recently? How is it related to NeRFs? And how is it different/better than rendering triangles/voxels/SDF? Is it just ray-marching these 3D gaussian shapes? Why is a gaussian used specifically?
- bradleyishungry 3y agoIt’s not related to NeRF’s at all. It does use CUDA but it’s just rendering a scene with particles as gaussians in screen space
- slalomskiing 3y agoI don’t think that’s correct, the abstract page of the original paper mentions NeRFs https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/
- bradleyishungry 3y agoYou’re correct in that, i could have picked different wording. it can be used to create radiance fields, but in a way that is completely different than NeRFs.
- orbital-decay 3y agoInspired by NeRFs (renders radiance fields as well) but is faster. It's a point cloud with fuzzy points that have size, shape, and direction, not just color/alpha. It has the same niche and up/downsides as point clouds, and the recent wave of interest is due to the easy reconstruction and rendering of photorealistic scenes from a few photos.
- lostdog 3y agoNeRFs were cool, but it turns out you get just-as-good results by fitting these Gaussian blobs. Plus it's faster. Plus the representation of gaussians is much easier to edit than the opaque neural representation. It's better than other representations because...no one has been able to reconstruct scenes with other representations this well. Gaussian splatting is not popular because it's a good rendering method. It's popular because there's now a good technique for generating great 3d gaussian splats from 2d images. And now that you have gaussian splats, it's nice to render them quickly.
- greesil 3y agoThis seem like poisson fitting for a point cloud, but with they're interested in doing more than recreating a surface. https://doc.cgal.org/latest/Poisson_surface_reconstruction_3/index.html https://doc.cgal.org/latest/Poisson_surface_reconstruction_3...
- prox 3y agoWould be interesting if researchers would start using Blender/Godot instead of Unity/Unreal since they are not truly open source. But I guess you might need a particular skillset for this to work with, which might come from the pro game development community which might be more familiar with these studio tools.
- liuliu 3y agoThe author "Aras P" worked for Unity close to 2 decades (retired beginning of this year). Doesn't invalidate what you said, just some background on why Unity :)
- prox 3y agoAh yes! That would explain, especially since it is such a novel technique you probably want to work in your home turf program :) Impressive work in any case!
- aras_p 3y ago(blog post author here) Most of actual research I've seen (i.e. papers) are not Unity/Unreal, they rather are CUDA/Python. The "Unity Gaussian Splatting" is not a research per se, just integration of that existing technique into Unity. As for why Unity, well yeah that's because I have experience with it, and am comfortable using it. There's many other people experimenting with in in web ecosystem (WebGL, WebGPU, three.js, aframe etc.), that you can say is properly open source. Blender as is right now is lacking certain functionalities to efficiently do gaussian splatting. However, for upcoming Blender 4.1 several pieces are landing - I have extended PLY file importer to be able to import custom attributes (as needed by gaussian splats), someone else contributed APIs to be able to write compute shaders from a Python addon. Once various pieces like that are in place, someone could indeed make a decently performant gaussian splat add-on or something.
- prox 3y agoThanks for your response and incredible work, and also to learn people are using different toolsets. Its great to hear Blender 4.1 is also shaping up to be a landmark release. Compute shaders are a new interest of mine so hopefully I can do some playing around with it. Do you think we will see Gaussian splatting integrated into a game in the (near or not near) future?
- DrNosferatu 3y agoAny actual games rendered with Gaussian Splats?
- scentoni 3y agoFor decades, Gaussian basis functions have been used for quantum chemistry: https://en.wikipedia.org/wiki/Basis_set_(chemistry) https://en.wikipedia.org/wiki/Basis_set_(chemistry)