Define a utility across the outcome distribution, eg., profit/quality-adj-life-years-etc. 95% of ML "research" would reveal itself pretty useless if people did

Define a utility across the outcome distribution, eg., profit/quality-adj-life-years-etc. 95% of ML "research" would reveal itself pretty useless if people did this, since the "80-90%" accuracy we're getting is on the "break-even" part of the profit-curve. We're not getting innovation. It's very rare that frequentist stat modelling on historical data would produce anything, in this sense, suprising -- ie., suprise in the utility domain