4 ms·
I feel like you really need to mention BabyLM. For example you have: > Directions we think are wide open ... Curriculum learning BabyLM and offshoot published
by Mumps 7mo ago
I feel like you really need to mention BabyLM. For example you have:
> Directions we think are wide open ... Curriculum learning
BabyLM and offshoot published a pretty convincing body of work on exactly that (which suggests it's not particularly relevant to LM training).
As I read your page, I really felt like the brevity-thoroughness tradeoff went the wrong way.