2 ms·
> You're going to have to break the Turing Test before you get good automated content curation. There will always be error. Yes, but even a competent AI curati
by leepowers 10y ago
> You're going to have to break the Turing Test before you get good automated content curation. There will always be error.
Yes, but even a competent AI curation system is going to make mistakes. The only relevant question is "what is an acceptable rate of error?". (Hint: 0% is not an acceptable answer.) We may be able to get to an acceptable rate (or may already be there) with or without AI-complete.
> People are worried about bias ... Information aggregators should have their members clearly spell out their positions on popular issues
This isn't a problem that can be solved with meta-data. An aggregator could write a beautiful, open-minded mission statement and still write trash. Hell, Google's unofficial mantra is "don't do evil". Well, ok then, there's nothing to worry about, Google has clearly spelled out their position, so there's no need to analyze or criticize their policies.
A policy statement or any other meta-data is not going to solve this. As you correctly noted an AI that passes the TT may be one way to work around this. But I'm skeptical. Any such AI would be at least as complicated as human intelligence, including all the foibles and errors that entails. An AI without our cognitive hang-ups would be smarter and more capable than us. Which would not increase my trust, and possibly decrease it, as the AI would no doubt have a bias to curate stories in it's own favor, or that put it (and AI in general) in the best light.
Bias is an unavoidable component of any curation.
- PhasmaFelis 10y ago> The only relevant question is "what is an acceptable rate of error?". (Hint: 0% is not an acceptable answer.) Certainly it is. That just means you're admitting that the problem cannot be satisfactorily solved by current AI and must be left to humans for now.
- Sacho 10y agoI doubt the error rate was 0% with human curators. In fact, the article itself does not compare the error rate of the human curators to algorithm, just examines that it was above zero after the humans were removed. I think an acceptable statement to make would be that the human curators probably reduced the number of "fake stories", but that's not why they were removed. It's a different judgement call whether the trending feed is "better" or "worse" in some holistic sense. Furthermore, there seems to be an implicit assumption that Facebook's Trending stories should not contain "fake stories", but is that the intended goal of the service? I actually have no idea, since I've never used it.