3 ms·
The results are impressive, but what makes this 4D? Where’s the extra dimension and how is it relevant to 3D human beings?
by latexr 2y ago
The results are impressive, but what makes this 4D? Where’s the extra dimension and how is it relevant to 3D human beings?
- thomastjeffery 2y agoTime
- cooper_ganglia 2y agoWe are all 4-dimensional beings on this fine day.
- philipov 2y agoWe're 3+1 dimensional beings. Time doesn't have the same metric as spacial dimensions, so you can't add them together. You can't rotate a temporal object along the xt-plane, for example, nor can you speak about an object's length along the t-axis. The three spacial dimensions are interchangeable, but time is special, so calling it 4D is incorrect.
- cooper_ganglia 2y agoWe are all rotating around the t-plane, constantly, at a consistent rate that will never stop.
- tantalor 2y agoThe input videos already have that dimension, so that can't be the answer.
- thomastjeffery 2y agoI agree that it shouldn't be, but it is apparent that it (redundantly) is.
- latexr 2y agoBy that logic all videos would be (at least) 3D. But no one would take you seriously if you said that.
- echelon 2y agoVideos are already 4D. There's the 2D frame and the time dimension. Then there's the structural information conveyed by motion, parallax, scene composition, camera movement, etc. That's why there's the 180 rule, amongst other things. Algorithms can take a video and turn it into a 4D volume. As can our brains.
- netruk44 2y agoThe reconstruction is a 3-dimensional scene that has animation contained in it. You can move a virtual camera 3-dimensionally within the scene at any individual frame (x, y, z), and also move the scene through its animation to play the animation forwards and backwards (in other words, you move the camera through the 'time' axis).
- latexr 2y ago> in other words, you move the camera through the 'time' axis So, like the scrubber in any video? Doesn’t feel like that warrants the 4D moniker. Which is not to say you’re not right, I think you are and that’s what they mean, but it that being the case it feels more buzzword than anything.
- radicality 2y agoI think it means that, given a normal flat 2D video, you get back that video but as a 3D scene, meaning you can move and pan the camera around as the 3d video plays. And I guess they call it 4D since you had a flat 2d video + time dimension, so 3d video + time dimension = 4 dimensions.
- netruk44 2y agoYes, it’s like a video scrubber. But it’s perhaps more like the timeline in Blender/Maya, and maybe even Cinema4D ;) You are correct though, they both serve the same function. However, I’ve yet to see a video player that lets you reposition the camera as if you were using photo mode in a video game. That’s (essentially) what this thing offers.
- aaroninsf 2y agoThis work is about taking an input with 2 spatial dimensions, plus 1 time dimension, and synthesizing a (limited) model with 3 spatial dimensions, plus 1 time dimension. 3D over time is colloquially called "4D;" though we don't call video "3D" by analogy as the term binds strongly to its purely spatial use.
- aaroninsf 2y agoRe: relevance, once of the prospective uses of work like this is in conversion of "flat" conventional video into "spatial" video, eg as popular on the Apple Vision Pro. I've been interested in the state of the art in that domain myself, having thousands of 2D videos I've shot which I would love to see "spatialized" well, someday.
- deleted 2y ago[deleted]
- latexr 2y ago> 3D over time is colloquially called "4D;" Colloquially, meaning “used in or characteristic of familiar and informal conversation” 4D films have a definition, and that ain’t it. 3D over time is colloquially still referred as 3D, as evidenced by decades of 3D blockbusters. https://en.wikipedia.org/wiki/3D_film https://en.wikipedia.org/wiki/3D_film https://en.wikipedia.org/wiki/4D_film https://en.wikipedia.org/wiki/4D_film