2 ms·
There is nothing about a computer algorithm that renders it immune to the power structures around it. The people who train these systems don't even realize they
by danharaj 10y ago
There is nothing about a computer algorithm that renders it immune to the power structures around it. The people who train these systems don't even realize they are creating a biased model. Borrowing from postcolonial theory, this is related to the concept of epistemic violence. The way we organize human information, the way we categorize and evaluate viewpoints and ways of understanding the world is a battleground for imperialism. Intent does not matter. The algorithm has no intent, the researchers don't intend to create a vehicle of oppression, and yet it happens anyway. They have created a difference in economic utility between standard, hegemonic English, and marginalized dialects of English which inevitably will have social ramifications. If this study weren't conducted, would we have ever found out?