4 ms·

Interesting, so it could be similar to how our brains store knowledge, but could also be completely different. This makes me wonder if these models are perfect

• TeMPOraL 4y ago
  > This makes me wonder if these models are perfect universal translators once they “grasp” a concept. I don't have a paper reference, but earlier this month I've seen claims that in training GPT-4, it was observed that additional training in a specific task using a single language (e.g. English) improves performance for that task in many languages, strongly suggesting the model is actually learning concepts, not just words. If that's the case, then I think we have indeed accidentally made a universal translator (limited to humans, though).
  • prox 4y ago
    Ergo, if we train on say a bird or primate, or perhaps dolphins, it might be able to grasp concepts animals use? Say lots of video footage with context?