My read on this was that you can just dump the lagged values as inputs and let the network figure it out just as well as the other, time series specific models

My read on this was that you can just dump the lagged values as inputs and let the network figure it out just as well as the other, time series specific models do, not that time doesn't matter.