4 ms·
> It will also fail to capture the language and the norms of countries and peoples that have less access to the internet and thus a smaller linguistic footprint
by actuator 6y ago
> It will also fail to capture the language and the norms of countries and peoples that have less access to the internet and thus a smaller linguistic footprint online. The result is that AI-generated language will be homogenized, reflecting the practices of the richest countries and communities.
It seems amusing to read this when the same person and her followers hounded Yann LeCun for pointing out the same thing with image models.
Anyway, this seems interesting. But I am not sure how you solve this. Do we take representative dataset according to population of a place? Also, assuming this is limited to a single language. How can AI generated language account for nuances from regional differences at the same time in a common model. Isn't what the author asking for here is kind of train, en_US, en_GB, en_IN separately here. For things like completion don't language models already account for this?
- lopmotr 6y agoThat's a problem for lots of technologies. The native language in my country hardly has any literature published in it because it's so obscure. How should the printing press solve this unfairness? The internet in general also doesn't use it much at all, neither do all the popular movies and TV series. They don't even get subtitled. Apple Maps can't pronounce the street names correctly for navigation either. It's pretty hopeless but does it really matter? Maybe if you have an unpopular language, that's just unfortunate and please encourage your kids to learn English (which they probably do at school just about everywhere anyway) so you don't perpetuate the same problem to the next generation.