Is model collapse inevitable Short answer --- yes. It is the only *logical* outcome. In most engineering endeavors, errors tend to accumulate and grow over t

Is model collapse inevitable Short answer --- yes. It is the only *logical* outcome. In most engineering endeavors, errors tend to accumulate and grow over time. Why should AI be any different? As the time honored saying goes --- "Garbage in, garbage out". "Intelligence" that can't tell fact from fiction well enough to disregard it's own hype can do nothing but recursively suck it back in and produce more of the same over time. The really disturbing part for me is the realization that a lot of technical *people* exhibit similar tendencies. ... where an arguably more realistic assumption is that data accumulate over time. This can only be achieved with infinite storage --- which is expensive both to store and search and --- (wait for it) *unrealistic*.