3 ms·
> This makes me wonder if these models are perfect universal translators once they “grasp” a concept. I don't have a paper reference, but earlier this month I'
by TeMPOraL 4y ago
> This makes me wonder if these models are perfect universal translators once they “grasp” a concept.
I don't have a paper reference, but earlier this month I've seen claims that in training GPT-4, it was observed that additional training in a specific task using a single language (e.g. English) improves performance for that task in many languages, strongly suggesting the model is actually learning concepts, not just words.
If that's the case, then I think we have indeed accidentally made a universal translator (limited to humans, though).
- prox 4y agoErgo, if we train on say a bird or primate, or perhaps dolphins, it might be able to grasp concepts animals use? Say lots of video footage with context?