2 ms·
If you dislike a _b_ version of an a/b tested site to the point that you feel deeply dissappinted by it, were the people who designed the experiment operating w
by eptcyka 6y ago
If you dislike a _b_ version of an a/b tested site to the point that you feel deeply dissappinted by it, were the people who designed the experiment operating with a malicious intent?
I don't think facebook engineers or data scientists care what people feel when they're adjusting their models, they only care about time spent on their platform or some other overly reductionist metric. One could argue that chasing super-efficiency will always result in abominations, but I think its hard to say that someone is doing something imoral by just doing the human equivalent of gradient descent in the optimization problem of driving engagement. That's not to say that we shouldn't have a conversation about this and not figure out ways to make these super efficient and powerful companies find ways to be satisfied with organic engagement.
- dheera 6y agoThere's a difference between disappointment about a product (which is fine) and doing an experiment to test that might knowingly create bad feelings in someone's life in one cohort of your experiment. What if an almost-suicidal person got the "b" version? A/B testing should be used when you think, in good faith, that BOTH "a" and "b" versions could be good and want to know which one works better, not to confirm a hypothesis that "b" has a negative impact on users' personal lives.