The real goal of this research is developing models that match or exceed human understanding of the 3D world -- a key step toward AGI. A key reason why current

The real goal of this research is developing models that match or exceed human understanding of the 3D world -- a key step toward AGI. A key reason why current Large Multimodal Models (LMMs) still have inferior visual understanding compared to humans is their lack of deep comprehension of the 3D world. Such understanding requires movement, interaction, and feedback from the physical environment. Models that incorporate these elements will likely yield much more capable LMMs. As a result, we can expect significant improvements in robotics and self-driving cars in the near future. Simulations + Limited robot data from labs + Algorithms advancement --> Better spatial intelligence which will lead to a positive feedback loop: Better spatial intelligence --> Better robots --> More robot deployment --> Better spatial intelligence --> ...