For production we usually just use some form of a/b testing, as we found out that the offline metrics are often misleading. When the offline metrics of your mod

For production we usually just use some form of a/b testing, as we found out that the offline metrics are often misleading. When the offline metrics of your model Like f1 or whatever are good enough we just promote the model to production competing we the other models in a multiarmed bandit way.