3 ms·
I'm not sure what you mean, but that is pretty much what generative neural systems do. If by information you mean data that correspond to reality? Than sure. I
by ObscureScience 5y ago
I'm not sure what you mean, but that is pretty much what generative neural systems do. If by information you mean data that correspond to reality? Than sure.
I guess you can say that the data is a correlated to reality by a certain probability, and the better the model the higher the probability?
- actually_a_dog 5y agoInformation in the sense of information theory. You can't squeeze n+1 bits out of n bits of information.
- webmaven 5y ago> You can't squeeze n+1 bits out of n bits of information. Sure, in the extractive sense. But in the generative sense you can. The fact that the extra information is 'synthetic' and not 'natural' doesn't mean that it isn't extra info, just that it may or may not (probably not) correspond with ground truth. Another way to think of it is that super-resolution is effectively a (possibly benign) man-in-the-middle. If what you're concerned about is the information flowing from Alice to Bob, Eve isn't adding any info, and may in fact be drowning the signal in more noise. But you can also see it as Eve communicating more info to Bob than Alice is to Eve. Whether what Eve is adding should be considered noise or signal is highly context dependent.
- actually_a_dog 5y agoOkay, then where does the information come from? A deterministic algorithm can't generate information where none exists.
- webmaven 5y ago> A deterministic algorithm can't generate information where none exists. Right. All the processes being used for these purposes are stochastic. Edit: Actually they are deterministic, in the same way a pseudo-random-number-generator is, and typically rely on a 'seed' that would have to come from a random source to be non-deterministic, and doesn't, so users get to have pseudo-random but reproducible results. But that's really getting into the weeds.