4 ms·

Yeah that struck me too. I can see the reasons why you'd want it but the collateral damage on that must be huge. For example do they check for the common but n

Yeah that struck me too. I can see the reasons why you'd want it but the collateral damage on that must be huge. For example do they check for the common but nonstandard transliteration systems arabic speakers use? There have to be similar systems in other languages that don't use the roman or cyrillic alphabets too right? Or for that matter what about languages twitter simply isn't aware of? There are thousands with native speakers after all, does this make it basically impossible for them to organically use twitter together?

Mezzie 4y ago
Also RIP the Conlang community on Twitter...
AmericanChopper 4y ago
I speak a language that is highly colloquialized, and in its casual written format includes a rather inscrutable system of abbreviation (one of the features of this system is to basically omit nearly all vowels). I had always figured that this language would be impossible for machines to translate, but I just tested it and both google translate and ChatGPT can accurately identify the language and translate the slang into English (Google didn’t pick up some of the subtleties between similar dialects, but still provided a correct translation). So I’m somewhat optimistic that they could be potentially managing these problems quite well.
- overboard2 4y ago
  What's the language?
  - AmericanChopper 4y ago
    Indonesian. ChatGPT could quite reliably tell the difference between Indonesian and Malaysian. Google translate seemed to have a bias towards thinking it was Malaysian. But if I tried Indonesian mixed with Javanese slang (which is a common way of talking), they would both just say it was Indonesian. I only tested a few phrases though, so maybe it breaks down at some point.
Closi 4y ago
Why do we assume that Twitter, a global communications company which has had offices in Dubai, might not consider the nonstandard transliteration requirements of Arabic, the 4th largest language in the world, which would mean that they would now be only showing content that is explicitly non-Arabic to Arabic speakers? We aren’t giving them enough credit here IMO!

Mezzie 4y ago

Also RIP the Conlang community on Twitter...

AmericanChopper 4y ago

I speak a language that is highly colloquialized, and in its casual written format includes a rather inscrutable system of abbreviation (one of the features of this system is to basically omit nearly all vowels). I had always figured that this language would be impossible for machines to translate, but I just tested it and both google translate and ChatGPT can accurately identify the language and translate the slang into English (Google didn’t pick up some of the subtleties between similar dialects, but still provided a correct translation). So I’m somewhat optimistic that they could be potentially managing these problems quite well.

overboard2 4y ago
What's the language?
- AmericanChopper 4y ago
  Indonesian. ChatGPT could quite reliably tell the difference between Indonesian and Malaysian. Google translate seemed to have a bias towards thinking it was Malaysian. But if I tried Indonesian mixed with Javanese slang (which is a common way of talking), they would both just say it was Indonesian. I only tested a few phrases though, so maybe it breaks down at some point.

Closi 4y ago

Why do we assume that Twitter, a global communications company which has had offices in Dubai, might not consider the nonstandard transliteration requirements of Arabic, the 4th largest language in the world, which would mean that they would now be only showing content that is explicitly non-Arabic to Arabic speakers? We aren’t giving them enough credit here IMO!