4 ms·
Yeah that doesn't address the point. The output of an LLM is a compression. It has errors. Recursive training would seem to create iterations that become more n
by sirsinsalot 2y ago
Yeah that doesn't address the point. The output of an LLM is a compression. It has errors. Recursive training would seem to create iterations that become more noisy. There's no new information, just a lossy distillation of the previous iteration.
I'm not sure what stops that.
- Xmd5a 2y agoI'm not into ML so I can't answer your question specifically, but it seems your circular google translate or jpeg comparisons are missing the essential element: self-evaluation https://x.com/search?q=synthetic%20data%20self-improvement https://x.com/search?q=synthetic%20data%20self-improvement
- sirsinsalot 2y agoYou're not into ML, got it.