4 ms·
I'm actually working on this area. I don't see any clear breakthroughs yet, but this is a very exciting area. There is a lot that is not clearly understood abo
by tellarin 3y ago
I'm actually working on this area. I don't see any clear breakthroughs yet, but this is a very exciting area.
There is a lot that is not clearly understood about some of the emergent-style abilities of these models or where growth by scaling will hit a limit.
So looking into reasoning, what they can and can't do, and what tools/designs, can provide benefits has great potential to inform the next generation of models.