3 ms·

Information in the sense of information theory. You can't squeeze n+1 bits out of n bits of information.

• webmaven 5y ago
  > You can't squeeze n+1 bits out of n bits of information. Sure, in the extractive sense. But in the generative sense you can. The fact that the extra information is 'synthetic' and not 'natural' doesn't mean that it isn't extra info, just that it may or may not (probably not) correspond with ground truth. Another way to think of it is that super-resolution is effectively a (possibly benign) man-in-the-middle. If what you're concerned about is the information flowing from Alice to Bob, Eve isn't adding any info, and may in fact be drowning the signal in more noise. But you can also see it as Eve communicating more info to Bob than Alice is to Eve. Whether what Eve is adding should be considered noise or signal is highly context dependent.
  • actually_a_dog 5y ago
    Okay, then where does the information come from? A deterministic algorithm can't generate information where none exists.
    • webmaven 5y ago
      > A deterministic algorithm can't generate information where none exists. Right. All the processes being used for these purposes are stochastic. Edit: Actually they are deterministic, in the same way a pseudo-random-number-generator is, and typically rely on a 'seed' that would have to come from a random source to be non-deterministic, and doesn't, so users get to have pseudo-random but reproducible results. But that's really getting into the weeds.