4 ms·
I am certainly not smarter than you, especially in the context of LLMs and DL. I think existing DL models would have a tough time with such interpolation becaus
by dr_kiszonka 3y ago
I am certainly not smarter than you, especially in the context of LLMs and DL. I think existing DL models would have a tough time with such interpolation because 1) they don't seem to understand human anatomy, and 2) the space of all possible transitions is massive.
I remember reading about human pose estimation algorithms[0], which would be a good first step. You could apply them to photos that you would like to interpolate between. I am not sure how you would train the interpolation model, though. Perhaps you could use OpenSim Models [1] in combination with reinforcement learning [2]?
There is also some literature on pose forecasting [3, 4].
0. Deep Learning-Based Human Pose Estimation: A Survey: https://github.com/zczcwh/DL-HPE https://github.com/zczcwh/DL-HPE
1. OpenSim: https://simtk.org/projects/opensim/ https://simtk.org/projects/opensim/
2. BioImitation-Gym: http://umishra.me/bioimitation-gym/ http://umishra.me/bioimitation-gym/
3. Human Pose Forecasting: https://paperswithcode.com/task/human-pose-forecasting https://paperswithcode.com/task/human-pose-forecasting
4. PoseGPT (name of the year!): https://www.ecva.net/papers/eccv_2022/papers_ECCV/papers/136660409.pdf https://www.ecva.net/papers/eccv_2022/papers_ECCV/papers/136...
- samstave 3y ago>>"...because 1) they don't seem to understand human anatomy, and 2) the space of all possible transitions is massive..." I have often thought that we need an empirical-ish library of human movement/positions... we have a beginning small version with Ballet's positions and movements, but we dont have a necessarily precise dialogue for human positions common to every body, as opposed to just the athletic dancers. aside from maybe "Do the Robot!"
- samstave 3y agoHow to train 3D riggings based on the above? I wanted to do this in 1998 with POSER 3D