Many comments are focussed on how this will affect models in deployment, but a more troubling implication for me is that evaluations and comparisons across mode

Many comments are focussed on how this will affect models in deployment, but a more troubling implication for me is that evaluations and comparisons across models using past data are affected by this.