7 ms·
In the context of the last trend of nlp a word is defined by its context, if a word is mostly used as a derogatory term in the corpus that the model has been tr
by chudi 5y ago
In the context of the last trend of nlp a word is defined by its context, if a word is mostly used as a derogatory term in the corpus that the model has been trained it will most likely be used as a flag to classify the content as hatespeech
- TchoBeer 5y agoDo people use yiddishisms derogatorily?
- weimerica 5y agoNot sure if I’m understanding “yiddishism” correctly here, but internet anti-Semites do mock kvetching all the time.
- notyourday 5y agoYes, since internet anti-Semites mock kvetching anyone using yiddish words in a comment on a post about yiddish institution is an anti-Semite engaging in hate speech. https://www.yiddishbookcenter.org/collections/oral-histories/excerpts/woh-ex-0002174/yiddishism-and-multifaceted-jewish-identity https://www.yiddishbookcenter.org/collections/oral-histories...
- deleted 5y ago[deleted]
- weimerica 5y agoI'm not sure your point? Absent the original commenter (you) providing context, that makes for reasonable supposition. Automated systems learn from a corpus that includes internet anti-Semites using Yiddishisms in a mocking manner to insult and inflame leads to false-positives on real-world, genuine uses. Similarly, how does one fish out the context and gauge just how appropriate (according to HN, never) a use of "n----r" and all its variants? Consider whether one should tell Joe Schmoe Black American he cannot use the word all to prevent Joe Schmoe White American from having a chance at using it to incite. It's a hard problem with many a false-positive to be had in ways that will befuddle, outrage, and amuse.
- chudi 5y agoThat's an excellent question, the ml modelers should ask those questioners themselves. There is a comment in this thread that in Spanish languages asking for a black ink cartridge (cartucho de tinta negro in Spanish) for a printer is automatically blocked because the word negro in hate comment is the word that has most signal for the classifier