4 ms·

Until you realize that ChatGPT is also fluent in 20 other languages by including minimal data into the training dataset.

• namaria 3y ago
  Minimal as in the amount a person needs to learn the language or minimal as in tiny if compared to English in common crawl but still orders of magnitude more than a person goes through for infancy language acquisition? I think you know the difference.
  • skybrian 3y ago
    It’s anecdotal, but here [1] is an example of AI learning to translate a new language faster than a human could learn to do it, from a similar amount of data, using Claude 3 Opus. Translating a language isn’t quite the same as understanding it, but this is still impressively data-efficient. [1] https://twitter.com/hahahahohohe/status/1765088860592394250 https://twitter.com/hahahahohohe/status/1765088860592394250
    • namaria 3y ago
      Did you read the "added context"? "The author has later responded and apologized a flawed / biased methodology which led them to believe that Opus has no prior knowledge of Circassian (i.e. wasn't trained on it) Apparently it was, and is able to speak Circassian just not perfectly"
      • skybrian 3y ago
        I didn't see that! Thanks!