3 ms·
There are no objective criteria for classifying flags as false positive/negative.
by brudgers 5y ago
There are no objective criteria for classifying flags as false positive/negative.
- walterbell 5y agoWhat does [flagged] mean? Users flagged the post as breaking the guidelines or otherwise not belonging on HN. Moderators sometimes also add [flagged] (though not usually on submissions), and sometimes turn flags off when they are unfair. A false positive is a user flag that was reversed on appeal, after manual review by HN human moderators. In a study, a list of false positive flags could be derived from public data. In a study, additional false positive candidates could be identified after manual review.
- brudgers 5y agoFlags add gravity. Sometimes, but only rarely, to the point of flagged-to-dead. Mostly flags just move submissions away from the top of the front page. It is very rare for those to be “deflagged.” Rare enough that there’s a moderation comment about turning flags off. And an appeal that the community be on its better behavior. They are editorial exceptions not rule following corrections.
- walterbell 5y ago> Flags add gravity. For the purpose of a study, gravity can be inferred from story rank. > Sometimes, but only rarely, to the point of flagged-to-dead. A study could examine the three categories of: - gravity - dead - unfair It would need to be long enough that all of those categories were non-zero.
- brudgers 5y agoThere’s no unfair…or fair. HN’s not a court of law.
- walterbell 5y agoThis sub-thread is about false positives, which has already been stated as a user-flagged event that was subsequently reversed by an HN moderator. That is a physically observable event that is visible in the HN public record, therefore it is an event that is subject to scientific study. It either exists or does not, so it is objective. In this sub-thread, "unfair" is quoted directly from the HN guidelines as the term for the objective event of a reversed flag, i.e. a "false positive", which we are discussing. It's not being used here as an adjective, it's being used to connect this discussion to the official HN FAQ.