3 ms·
Maybe it’s a hint that our current training techniques can create models comparable to the best humans in a given subject, but that’s the limit.
by OtherShrezzing 1y ago
Maybe it’s a hint that our current training techniques can create models comparable to the best humans in a given subject, but that’s the limit.
- ctoth 1y agoWe've hit the limit of 'our current training techniques'? This result literally used newly developed techniques that surprised researchers at OpenAI. Noam Brown: 'This result is brand new, using recently developed techniques. It was a surprise even to many researchers at OpenAI.' So your thesis is that these new techniques - which just produced unexpected breakthroughs - represent some kind of ceiling? That's an impressive level of confidence about the limits of methods we apparently just invented in a field which seems to, if anything, be accelerating.
- Jensson 1y ago> Maybe it’s a hint that our current training techniques can create models comparable to the best humans in a given subject, but that’s the limit. IMO is not the best humans in a given subject, college competitions are at a much higher level than high school competitions, and you have even higher level above that since college competitions are still limited to students.