3 ms·
No.
by fulafel 2y ago
No.
- belter 2y agoIs this paper wrong? - https://arxiv.org/abs/2311.09807 https://arxiv.org/abs/2311.09807
- simonw 2y agoIt shows that if you deliberately train LLMs against their own output in a loop you get problems. That's not what synthetic data training does.
- belter 2y agoI understand and appreciate your clarification. However would it not be the case some synthetic data strategies, if misapplied, can resemble the feedback loop scenario and thus risk model collapse?