Thanks for taking the time - this is all really helpful. You seem to have understood the situation well (unless I'm reading this like a horoscope) - there are

Thanks for taking the time - this is all really helpful. You seem to have understood the situation well (unless I'm reading this like a horoscope) - there are currently no decent, general solutions to my problem. Most recent papers use techniques that work well on images, apply them to video, show a couple of limited results and of course the authors don't publish any code. Conceptually, everyone can see that this class of techniques is not suitable, and whenever a paper is re-implemented the results are extremely poor. Basically, it looks like a dead end and I think even a tentative first step in a new direction would be counted as a success. But yes I will make sure to clarify this. So based on your advice, over the next few days I will nail down the techniques to try, write a short hypothesis for why I think each one can work, and plan my time so that I am able to run with a promising approach or combination of approaches for the last month or so. Thanks again. If you're interested, drop me an email and if I have something fun I will send you a copy of my writeup later this year.