3 ms·
Wikipedia should be data driven. Let the bikeshedders all try out their design in AB tests, and pick whichever the user metrics say is best. You're going to g
by londons_explore 5y ago
Wikipedia should be data driven.
Let the bikeshedders all try out their design in AB tests, and pick whichever the user metrics say is best.
You're going to get much better results that way than spending 4 years writing specifications and having meetings.
- jhasse 5y agoHow do you measure "best"?
- londons_explore 5y agoHighest likelyhood of returning to Wikipedia within 30 days, not including the day they saw the info card. If people find a site useful, they will voluntarily return again later. That's a very hard metric to game/abuse. Do not count a user returning from a promo email or browser notification or any of those dark patterns.
- creatonez 5y ago> Let the bikeshedders all try out their design in AB tests, and pick whichever the user metrics say is best. This is essentially exactly what happened. But after this was tried, contributors disagreed on which of the metrics are important. Is it more important that a Wikipedia user stays on the site to discover more tangential information, or is it more important that they leave the site as quickly as possible after finding the relevant information? User retention doesn't matter because it's Wikipedia, but which philosophy provides more social utility?