2 ms·
> To mitigate presentation bias, we can always pick a small fraction of users that are always shown uniformly random results Would it be equivalent to displayi
by mooneater 7y ago
> To mitigate presentation bias, we can always pick a small fraction of users that are always shown uniformly random results
Would it be equivalent to displaying a small number of random (exploration) items to each user in addition to algo recommended (exploitation) items, which seems more palatable?
- Arnie0426 7y agoThanks for your question! As long as you can compute the probability of each item being shown (regardless of whether it's uniform random or through your algorithm) to each user, the method still applies. While it does seem more palatable to just show a maximum of X% uniformly random items to all users, the computation of p(y|x) can get a bit hairy for any item y, because now it is a product of a uniform distribution and your stochastic ranking algorithm. If you _can_ compute that, you'd be fine.