3 ms·
Scaling can happen in many other places. Such as deeper iterative thought during inference such as Chain of Thought, Tree of Thought, which extracts increasingl
by BulgarianIdiot 3y ago
Scaling can happen in many other places. Such as deeper iterative thought during inference such as Chain of Thought, Tree of Thought, which extracts increasingly better performance out of existing parameter and data sizes.
Tried to explain here:
https://news.ycombinator.com/item?id=36054809 https://news.ycombinator.com/item?id=36054809