World Labs’ (Lee’s company) stated goal is to “[build] Large World Models to perceive, generate, and interact with the 3D world.” Imo video models are the clos

World Labs’ (Lee’s company) stated goal is to “[build] Large World Models to perceive, generate, and interact with the 3D world.” Imo video models are the closest thing we have to “spatial intelligence.” They generate in three dimensions (2D images + time) scale just like image and probably language models, and given the right controls can model 3D worlds (https://gamengen.github.io/ https://gamengen.github.io/) interactively. Not sure there’s a need to directly model polygons or point clouds (assuming that’s what they’re trying to do?) when there’s so much video data to enable massive scaling of video models. I expect soon we’ll see video models being used as planners for robotics as well.