3 ms·
> ... just because they have new knowledge. This means there is a future where AI is training on data it self generated, and I worry that might not be sustaina
by QuantumNoodle 1y ago
> ... just because they have new knowledge.
This means there is a future where AI is training on data it self generated, and I worry that might not be sustainable.
- techpineapple 1y agoI’ve heard of this idea of training on synthetic data, I wonder what is that data and does this increase or decrease hallucinations? Is the goal of training on synthetic data to better wear certain paths, or to increase the amount of knowledge / types of data. Because the second seems vaguely impossible to do.
- jgalt212 1y agoA software based Habsburg Jaw if you will.
- lazide 1y agoThis is already occurring, is not sustainable, and produces an effect known as Model Collapse.