It’s mind boggling that tracking history wasn’t maintained between object classifications. Surely the best thing to do would be to detect "object" -> track it

It’s mind boggling that tracking history wasn’t maintained between object classifications. Surely the best thing to do would be to detect "object" -> track it -> classify -> predict path -> back to classify