3 ms·
So more 'mature' models might arise in the near future with less params and better benchmarks?
by 3abiton 2y ago
So more 'mature' models might arise in the near future with less params and better benchmarks?
- raducu 2y ago"Better", but not better than the model they were distilled from, at least that's how I understand it.
- salemba 2y agoI think this is how the "child brain" works too. The better the parents and the environement are, the better the child evolution is :)
- cristiancavalli 2y agoNot at all — how many people were geniuses and their parents not? I can name several and I’m sure with a quick search you can too.
- iFreilicht 2y agoHow is that relevant? A few examples do not disprove anything. It's pretty common knowledge that the more successful/rich etc. your parents were, the more likely you'll be successful/rich etc. This does not directly prove the theory your parent comment posits, being that better circumstances during a child's development improve the development of that child's brain. That would require success being a good predictor of brain development, which I'm somewhat uncertain about.
- _w1tm 2y agoThey might also be more biased and less able to adapt to new technology. Interesting times.
- coder543 2y agoThat's been happening consistently for over a year now. Small models today are better than big models from a year or two ago.