6 ms·
This seems neat but I don't understand the use of 4D. It's not four dimensional. It's 3D with the ability to have an arbitrary perspective.
by pard68 3y ago
This seems neat but I don't understand the use of 4D. It's not four dimensional. It's 3D with the ability to have an arbitrary perspective.
- jorgemf 3y agoTime is the forth dimension. The input data is a video, so the model learns the colors and the position of the elements (basically points). You can rende the scene from any angle at any time once the models is trained
- GaggiX 3y agoIt has a time dimension.
- renewiltord 3y agoDownvoted at the time I see it, but actually correct. It's based on K-planes https://arxiv.org/pdf/2301.10241.pdf https://arxiv.org/pdf/2301.10241.pdf which effectively splits each space-time relationship off from the spatial relationship. It's just mathematics, guys. The original NeRF paper talked about a 5D coordinate. You know like a k-dimensional vector?
- bassrattle 3y agoIt's volumetric video
- easeout 3y agoSo's a video game, and we call that "real-time 3D". Time is mentioned, but it isn't counted again as a dimension, perhaps because any given momentary view is a time slice, not a time range like it is an XYZ range.
- datameta 3y agoI think the difference is that in a video game you are in one location only at any given moment and things travel only forward in time. We can view from any location at any time in volumetric video.
- ben-schaaf 3y agoSome games absolutely let you do that. It's not a limitation of the medium.
- datameta 3y agoI'm curious what are a few examples? I've missed the last decade of new games largely.
- ben-schaaf 3y agoCS:GO, TF2, GTA5 and Trackmania (and likely many more) have replay systems where you can pause, play and rewind with a freefly camera. Lots of games have a rewind mechanic: Grid, Baba is You & Viewfinder come to mind. Others have a "Photo Mode" where you can pause with a freefly camera: Starfield & Witcher 3 come to mind.
- fragmede 3y agoTalking about rewind mechanic in games, you can't possibly leave out Braid. https://store.steampowered.com/app/26800/Braid/ https://store.steampowered.com/app/26800/Braid/
- datameta 3y agoValid, yeah. It occurs to me though that the difference is we are making a representation of the real world that can be manipulated like such, as opposed to a simulation of a fabricated world.
- johnnyworker 3y agoNot a freefly cam but, this was 1989 after all: https://en.wikipedia.org/wiki/Indianapolis_500:_The_Simulation#Replay_mode https://en.wikipedia.org/wiki/Indianapolis_500:_The_Simulati...
- madmads 3y agoYea it's probably to have a catchy name and get some attention. Although it's technically accurate to call it 4D since it includes time, I think 3D video recording would probably get the point across to more people in a less sensationalist way.
- jayd16 3y agoIs it technically accurate? Seems like its actually 6Dof view angles + time. The paper mentions 4D view, 4D point cloud, dynamic 3D scene and 4D feature grid.
- jahewson 3y agoIf I’m understanding the paper correctly then the four dimensions are the position, density, radius, and color of the spheres in their volumetric model. So for any given viewing position and point in time, their model produces a 4D scene that is then rasterized to 2D.
- rangewookie 3y ago3D + video (motion) It's not a 3D model that is animated using a skeleton and keyframes like traditional 3D. It's many consecutive 3D models that create the illusion of continuous motion (aka video). 4D is the name that has come to describe the jump from static 3D models (photogrammetry) to 3D "video" models.
- firtoz 3y agoWhen it comes to volumetric clouds, the D stands for how many dimensions you store the points in. A 2d volume (similar to an image) has pixels stored in 2d coordinates A 3d volume has points stored in 3d coordinates. Imagine an image for every vertical slice of a brain scan. A 4d volume has points stored in 4d coordinates, where the newest dimension is time. Imagine a 3d volumetric capture for each frame in time.