4 ms·
I once read an article (probably on here) where a developer started tokenizing language into phonemes and then matching those against a list of verboten sounds.
by ultrarunner 4y ago
I once read an article (probably on here) where a developer started tokenizing language into phonemes and then matching those against a list of verboten sounds. This prevented people (students?) from getting around literal filters. Basically hashing for English, where words like phat and 1337 could be matched. It always seemed like such an elegant and effective solution to a human vs computer problem. It would make a great library.
- _Algernon_ 4y agoWhy do we need to prevent people from expressing themselves? Why do we need to encourage such self-censorship as evident here? Why would the existence of such a library be a good thing? Language is contextual. The use of certain terms is rude in some contexts, not in others. An algorithm will never be able to distinguish the two without being an AGI. The only thing this encourages is self-censorship and dampening of expression.
- FractalHQ 4y agoThe irony is that slurs gain their potency from their novelty which is emboldened by censorship and hindered by exposure. If taboo language was used freely and often, it would lose its shock value and subsequently its power to harm people sensitive to it.