3 ms·
Ask HN: How come ChatGPT can translate?
I can understand how factual knowledge can be acquired through language modeling. But what is in the training data that would make it be able to translate between languages?
- ofalkaed 2y ago99% translation dictionaries and grammars from what I have seen. AI does not really translate, it does not understand the context but can sort of fake understanding the languages in a very technical sense which works well enough when you don't know the language at all but loses all the nuance. Edit: 99% is a bit hyperbolic, AI has a good amount of human translations to work off of as well which helps it with idiomatic/figurative language but it is still not translating, just playing the odds.
- arthurcolle 2y agocheck this out puttycat https://pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html https://pytorch.org/tutorials/intermediate/seq2seq_translati...
- puttycat 2y agoThanks, this explains how one trains a translation model but not how this kind of data appears in an organic corpus
- talldayo 2y agoword association