Can't speak to the overall AI Labs model reasearch but this pixel tracking is directly tied to computer vision and what they are doing at Reality Labs advancing

Can't speak to the overall AI Labs model reasearch but this pixel tracking is directly tied to computer vision and what they are doing at Reality Labs advancing Mixed Reality passthrough with geometry mapping of your surroundings and hand based gesture controls. There is a lot of computer vision baked into those chips and while this is published I am sure they have productized it using more advanced proprietary methods under patent.