3 ms·
This whole line of thought is sort of funny. Yes you can try training a model on synthetic data in such a way that it experiences model collapse That doesn't m
by wrsh07 1y ago
This whole line of thought is sort of funny. Yes you can try training a model on synthetic data in such a way that it experiences model collapse
That doesn't mean there aren't ways to train a model incorporating synthetic data without seeing model collapse
- NitpickLawyer 1y ago> This whole line of thought is sort of funny. This line of thought was exacerbated by that one paper that was then parroted (hah!) by every influencer / negativist in the space. It didn't matter that the paper was badly executed, their setup was flawed and that it got rendered moot by the existence of LLama3 models. People still quote that, or the "articles" stemming from it.