4 ms·

I think I've got a twitch now, when I think about this. How those stupid moviemakers would say, "enhance!" and I (along with many of my geek brethren) were like

I think I've got a twitch now, when I think about this. How those stupid moviemakers would say, "enhance!" and I (along with many of my geek brethren) were like, "there are no more pixels, that can't be done!" And now it exists. "Enhance" exists.

kyriakos 3y ago
Or does it? If you enhance security footage to make a barely visible face recognizable it will make it but it won't be the person in the footage anymore.
- wood_spirit 3y ago
  It would be really interesting to see what it upscales poor security footage to be when we know the people in the picture; how accurate was it?
  - wruza 3y ago
    The models usually bundled with ESRGAN don't enhance like CSI. They straighten lines and jpeg blocking a little and correct "subatomic" details, but cannot restore large areas like faces, objects, etc. It's more of an AI-flavored "Effects - Sharpen" than stereotypical "Enhance!".
  - 112233 3y ago
    You probably remember this: https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-added-ryan-goslings-face-to-this-photo/ https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-a...
- kookamamie 3y ago
  It does not exist. The AI models generate "what could be" instead of "what was", i.e. they hallucinate heavily in upscale tasks.
  - lostlogin 3y ago
    > It does not exist. The MRI scanner near you is potentially using AI to increase image signal, then to increase pixel count 4x (well, 2x in X direction, 2x in Y direction. Potentially also generating a slice between each slice in 3D datasets). If you turn off the AI and actually acquire the information, the scan is long, the patient moves and it is blurry. However if the patient is still, the non AI images look like the AI images. Disagreeing with it is sort of moot now - it’s in the machines and is running. It works well, I’ve been using it daily for a few years. All vendors have it - I use the Siemens product ‘Deep Resolve’ [1]. Their PR department undersells it, in my view this is a bigger change than the 1.5T to 3T transition. [1] https://www.siemens-healthineers.com/magnetic-resonance-imaging/technologies-and-innovations/deep-resolve https://www.siemens-healthineers.com/magnetic-resonance-imag...
    - j16sdiz 3y ago
      The scanner is faster because it collect less data. The image is sharper because it have more data. Where did the missing data came from? It came from the training data set, not the patient. No matter how good the image look like, it is not something from from the patient.
      - tomrod 3y ago
        Yet, it can be "close enough" for horseshoes, hand grenades, and surgery.
        JeremyNT 3y ago
        Which may well be, but those detectives still aren't going to suddenly be able to read the license plate from an "enhanced" blurry photo, like their TV counterparts were doing back in the early 00s.
        tomrod 3y ago
        Correct. And the extrapolation region for the MRI is reasonable, I reckon, versus extrapolation into pulling enhanced blurry photos!
spookie 3y ago
The better example of "Enhance!" still remains this piece of software: https://www.youtube.com/watch?v=19wgu5GZDhk https://www.youtube.com/watch?v=19wgu5GZDhk

kyriakos 3y ago

Or does it? If you enhance security footage to make a barely visible face recognizable it will make it but it won't be the person in the footage anymore.

wood_spirit 3y ago
It would be really interesting to see what it upscales poor security footage to be when we know the people in the picture; how accurate was it?
- wruza 3y ago
  The models usually bundled with ESRGAN don't enhance like CSI. They straighten lines and jpeg blocking a little and correct "subatomic" details, but cannot restore large areas like faces, objects, etc. It's more of an AI-flavored "Effects - Sharpen" than stereotypical "Enhance!".
- 112233 3y ago
  You probably remember this: https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-added-ryan-goslings-face-to-this-photo/ https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-a...
kookamamie 3y ago
It does not exist. The AI models generate "what could be" instead of "what was", i.e. they hallucinate heavily in upscale tasks.
- lostlogin 3y ago
  > It does not exist. The MRI scanner near you is potentially using AI to increase image signal, then to increase pixel count 4x (well, 2x in X direction, 2x in Y direction. Potentially also generating a slice between each slice in 3D datasets). If you turn off the AI and actually acquire the information, the scan is long, the patient moves and it is blurry. However if the patient is still, the non AI images look like the AI images. Disagreeing with it is sort of moot now - it’s in the machines and is running. It works well, I’ve been using it daily for a few years. All vendors have it - I use the Siemens product ‘Deep Resolve’ [1]. Their PR department undersells it, in my view this is a bigger change than the 1.5T to 3T transition. [1] https://www.siemens-healthineers.com/magnetic-resonance-imaging/technologies-and-innovations/deep-resolve https://www.siemens-healthineers.com/magnetic-resonance-imag...
  - j16sdiz 3y ago
    The scanner is faster because it collect less data. The image is sharper because it have more data. Where did the missing data came from? It came from the training data set, not the patient. No matter how good the image look like, it is not something from from the patient.
    - tomrod 3y ago
      Yet, it can be "close enough" for horseshoes, hand grenades, and surgery.
      - JeremyNT 3y ago
        Which may well be, but those detectives still aren't going to suddenly be able to read the license plate from an "enhanced" blurry photo, like their TV counterparts were doing back in the early 00s.
        tomrod 3y ago
        Correct. And the extrapolation region for the MRI is reasonable, I reckon, versus extrapolation into pulling enhanced blurry photos!

spookie 3y ago

The better example of "Enhance!" still remains this piece of software: https://www.youtube.com/watch?v=19wgu5GZDhk https://www.youtube.com/watch?v=19wgu5GZDhk