4 ms·
The first paragraph is written to imply they have been filtered purposely: > has been extensively ‘filtered’ to remove black and Hispanic authors, as well as m
by have_faith 5y ago
The first paragraph is written to imply they have been filtered purposely:
> has been extensively ‘filtered’ to remove black and Hispanic authors, as well as material related to gay and lesbian identities
But after it is explained that this is an unintended second order effect from trying to remove offensive content from the corpus. I'm not trying to justify the outcome (it's an issue regardless of intent) I just didn't think there was any need to strongly imply it was intended.
- cratermoon 5y ago> an unintended second order effect from trying to remove offensive content from the corpus. How odd that "offensive" and "minority" turned out to overlap so much. How could that have possibly happened?
- User23 5y agoUse of the n-word is an obvious example.
- tablespoon 5y agoAlso "minority" tends to be associated with a lower socioeconomic status, which may imply cruder language with more swear words in general, etc.
- imbnwa 5y agoWhich Black folk use colliquially, either to imply that the addressee needs to be more humilitous or apply greater self-improvement about a subject at hand, or to re-enforce camraderie.
- brudgers 5y agoIt was intentional at least in so far as that bias is a known problem with Google's machine learning processes, and that no substantial effort was made to avoid the bias. Running over a pedestrian might be a second order effect of driving a car, except that driving a car includes applying the brakes to avoid it.