The underlying problem is termed "motion matching", "motion tracking" or "camera tracking". I played around with it around 2009 or so and at that time there wa

The underlying problem is termed "motion matching", "motion tracking" or "camera tracking". I played around with it around 2009 or so and at that time there was scant open-source libs for bits and nothing to join it together and nothing that worked particularly well; it was the domain of high-quality high-price niche products aimed at Hollywood which you could watch product videos of on YouTube but not actually afford to use. I don't know how accessible it is now; maybe there are now working quality open-source libs and we can all start putting it into raspberry pi robots? ;)