5 ms·
AAVE has a perfectly coherent grammar of its own (try e.g. ‘AAVE grammar’ on Google Scholar.) It is as grammatically ‘incorrect' as Scots.
by eynsham 3y ago
AAVE has a perfectly coherent grammar of its own (try e.g. ‘AAVE grammar’ on Google Scholar.) It is as grammatically ‘incorrect' as Scots.
- mewpmewp2 3y agoBut then I wonder, how would the results be for scots for example? Or other dialects? E.g. "Redneck English" perhaps.
- magospietato 3y agoI wouldn't worry about the truth of the matter; there's a US-centric cultural axe to grind here.
- mewpmewp2 3y agoI am not a native english speaker, but as a teenager I definitely used weird slang - actually I still do in my private conversations - that if had to be perceived by someone would definitely seem unprofessional, etc. But I would have been perfectly capable of changing wording to type grammatically correct version of the language expected anywhere in professional situations. Is the author implying that African Americans wouldn't be able to do that? Isn't that implication a bit racist in itself? E.g. are they saying that given a professional context they wouldn't be able to use the Standard English? I have seen plenty of African Americans or any race be able to speak grammatically decent standard English, wherever they are from. The whole thing feels like trying to trick the LLMs. If they were to use slang or private conversations of anyone versus standard American English it would be perceived as lower int/lazy.
- anonuser123456 3y agoI think OPs point is, there are other perfectly coherent grammars that also may produce the same result. Were those grammars tested? And a good follow on would be, if not, why was only one and how/why was it selected?
- theGnuMe 3y agoStill shows implicit bias and you know structural racism. It is actually looks like it could be a great measure of structural racism since the LLM is trained on everything...
- mewpmewp2 3y agoBut if for example my native language which is spoken by far fewer people than AAVE or Standard American English was given to LLMs, which LLMs also frequently fail at - especially anything besides GPT-4, and try to correct something that actually is correct, wouldn't it also naturally if it's forced to judge it rate it as more gibberish?
- theGnuMe 3y agoWhy not do the research instead of talking hypotheticals?
- mewpmewp2 3y agoI am asking questions and sharing thoughts about the research I saw above. I do not have the funds, time or motivation to do this type of research. Just my first thought about the article is that it is doing this "think of the children" type of thing to make a case for recalling something that is really useful for many people.
- mewpmewp2 3y agoYes, also to be clear, I am not from US and neither am I a native English speaker, but to me it's obvious that in professional or business context a person must put effort in to have seemingly clear and formal English, unless they are known as this highly skilled, experienced and an eccentric character so they could potentially pull off writing in however they please. So I would imagine that any deviation of this expected norm would yield in a result that might be perceived as more "stupid or lazy", whether it's street dialect, US southern, redneck dialect, teenager dialect, mix with other languages or otherwise. So my point is - that it's measuring a correlation from the standard, professional, business English, rather than it being anything to do with racism.
- theGnuMe 3y agoI wonder what happens if you do this for all of the UK English dialects. Do you see a similar effect between the queen's english and yorkshire?