Without a neural network one would probably use optical flow [1] and I guess you could train a neural network to predict optical flow and then use that flow to

Without a neural network one would probably use optical flow [1] and I guess you could train a neural network to predict optical flow and then use that flow to align the two inputs. I have no answer to your specific question, what kind of neural network architecture would be best suited but given the task it seems reasonable to assume some form of convolutional neural network. [1] https://en.wikipedia.org/wiki/Optical_flow https://en.wikipedia.org/wiki/Optical_flow