When we talk about commercialisation, it almost always has to do with business performance improvement. When you’re thinking about making a change to improve th

When we talk about commercialisation, it almost always has to do with business performance improvement. When you’re thinking about making a change to improve the performance of business, then you have to consider the benefits/risk ratio of your change (in this case, swapping for a better model). Say your model only increases performance by 1%. It’s unproven within the business and against the test of time. Not to mention someone generally needs to know how it works and maintain it. Someone needs to be responsible for the change and be able to explain why the new model is better (and will continue to stay better). And generally businesses buy solutions not releases of models. There’s a lot of additional work that goes into commercialising a model as a product than the actual model itself. I know because I’ve tried to do it before. We are working on developing software that will let us be more agile with ML and rapidly release new models to compete with existing models, which will help us learn about the effectiveness of new modelling techniques and help us build business cases.