One thing I'd like to see would be a comment section that uses a multi-armed bandit algorithm based on upvotes, or by something like Thompson sampling. So each

One thing I'd like to see would be a comment section that uses a multi-armed bandit algorithm based on upvotes, or by something like Thompson sampling. So each time you refresh, comments that have more upvotes tend to be shown earlier, but the fewer votes in total they have, the more it's up to chance where they appear. If it uses a deterministic MAB algorithm, it would put unvoted posts at the very top. The MAB algorithm is constructed to find the best choices (here, most liked posts), and it can't know what the true score of a comment is if nobody has voted on it yet. Thus the need for exploration would push those posts/comments very high.