2 ms·
Examples of emergence: 1. Multi-step reasoning with backtracking when DeepSeek R1 was trained via GRPO. 2. Translation of languages they haven't even seen via
by uh_uh 2y ago
Examples of emergence:
1. Multi-step reasoning with backtracking when DeepSeek R1 was trained via GRPO.
2. Translation of languages they haven't even seen via in-context learning.
3. Arithmetic: heavily correlated with model size, but it does appear.
I could go on.
Albeit it's not an LLM, but a deep learning model trained via RL, would you say that AlphaZero's move 37 also doesn't count as emergence and the model has no understanding of Go?