3 ms·
I like this idea in theory, but I think it would be difficult to scale up enough to be useful. Who would be the curators? If you open up curation to volunteers
by nagonago 4y ago
I like this idea in theory, but I think it would be difficult to scale up enough to be useful.
Who would be the curators? If you open up curation to volunteers, it could be gamed by bad actors. However if you have too small a team, the results will be limited and biased. For example, favoring the English-speaking or tech-sphere web while ignoring large sections of the web with which the curators are unfamiliar.
Perhaps machine learning could help with scale - start with a human curated dataset, then train a model on it. However that could end up getting gamed too.
- smt88 4y ago> Who would be the curators? That's a key question. You don't necessarily need that many of them, though, if you're whitelisting at the domain level. A few dozen people could work giving a rating to many thousands of domains every year. An ideal number might be in the thousands. I'd also say they probably shouldn't be in industry, because they'd have an incentive to game the index. > Perhaps machine learning could help with scale - start with a human curated dataset, then train a model on it. While this is true, I don't think search engines other than Google and Bing need to worry that much about being gamed. It's just not worth the effort.
- larksimian 4y agoI think curation by paying users could work. At least it would make manipulation quite expensive. Let people downvote/upvote search results as an extra strong signal on top of monitoring what they choose to click on in the result list. Also let people block domains from searches and provide some discoverability of commonly blocked domains.