2 ms·
> There is no lossy compression that gets better when you feed its output back into its own input over and over. It's basic information theory Sure there is. T
by SideQuark 4y ago
> There is no lossy compression that gets better when you feed its output back into its own input over and over. It's basic information theory
Sure there is. The goal of AI is not to memorize all information, but to make the ability to generalize, so "lossy" doesn't make sense.
For example, noisy data can be improved by successive filtering.
In fact, from an information theory argument, noisy channel coding shows exactly that information can be improved via multiple lossy passes: many modern error correcting codes have iterative decoders, each stage lossy at the level of input to out stages, yet each stage gets closer to the correct original message.
So the "lossy" and "information theory" argument doesn't work.