3 ms·
> The focus of many shipping conversations is how to address even unmeasured potential risks to these metrics. A huge number of experiments are run specifically
by tobltobs 5y ago
> The focus of many shipping conversations is how to address even unmeasured potential risks to these metrics. A huge number of experiments are run specifically targeted at improving these metrics.
How do you run tests on unmeasured metrics?
- mgraczyk 5y agoHow to "address", not "test". For example, you can add logging for specific cases or patterns that you expect to be problematic. You can spot check scores on individual ranked entities. You can do additional analysis or run experiments on certain subsets of the userbase to measure the impact on important groups of users.
- tobltobs 5y agoHow do you "measure the impact on important groups of users"?