3 ms·
Everyone in the ML field understands that ML-assisted upscaling doesn't produce output that accurately represents the original full-resolution image. It produce
by PragmaticPulp 6y ago
Everyone in the ML field understands that ML-assisted upscaling doesn't produce output that accurately represents the original full-resolution image. It produces output that humans perceive to be realistic-looking, or free of traditional upscaling artifacts.
While this is obvious to anyone familiar with the technology, it's difficult to explain to casual observers. The image output looks real. It feels like it could be real. It's free of traditional scaling artifacts that would trigger suspicion. Without additional explanation, it's easy to see why casual observers would assume the hallucinated upscaled version is an accurate representation of the original image.
Historically, police sketches and blurry surveillance images are obviously low quality enough that people inherently know they're approximations. The problem with these ML hallucinated upscaled images is that they look and feel real enough that they bypass people's suspicions. We can try to present them as "Here's what the suspect might look like", but when they look like a full-resolution photograph, people will simply assume that it's exactly what the suspect looks like.
- acheron9383 6y agoExactly, and then it is up to your defense attorney to somehow dispute that the AI just made up a face, that just happens to look like yours, and then explain it to 12 laymen who likely know nothing of how ML or computers work. The company that develops this tech will want to market themselves as some sort of oracle to the people and LEO. Junk forensic science sticks in courts forever, we should be careful before we assent to more.
- wmf 6y agoOne obvious problem is creating only one output face when there are many possible faces that match the low-res version. A tool that turns a low-res face into, say, 16 maximally-different upscaled versions doesn't suffer from the same level of false certainty.
- notdonspaulding 6y agoDoesn't it? You arbitrarily picked 16 possible photorealistic faces out of a total solution space of what? Millions? Wouldn't the balance of probability be on someone in the general population of humans more closely resembling one of your 16 candidate images than any of your candidates resembling the Ground Truth image? Doesn't the problem get both better and worse as you scale your N up from 16? That is, it would be better because one of your candidates is more likely to match the Ground Truth, but it would be worse because you've also widened your net for catching false positives?
- rabidrat 6y agoI saw the blurry picture of Obama and my brain thought "I think that's Obama". When it was 'enhanced' it became a (white) person that I would never recognize as Obama. In fact I did not recognize them at all. The image may have been a more probable person overall, but clearly not a more probably famous person. Which makes me wonder, can we train a model on only famous people, weighted by their relative famousness?
- ben_w 6y ago> can we train a model on only famous people, weighted by their relative famousness? Well, yes, but why would you want to?
- rabidrat 6y agoSo that we can take a picture of ourselves and have it tell us which famous person we most look like when blurry?
- bryanrasmussen 6y agoThe hit kids app of the summer.
- SkyBelow 6y ago>You arbitrarily picked 16 possible photorealistic faces out of a total solution space of what? Millions? Wouldn't the solution be to find a 4 different axes and pick faces that represent different endpoints. With a little psychology to help us identify what features are best to inform the public of we should be able to create a collection of photos that will be more likely to result in someone identifying the suspect than either the single photo option or the photo collection option. We would still need to test to see if it is better than the single lower quality photo option.
- deleted 6y ago[deleted]
- looping__lui 6y agoConsidering that many models are actually trained on L1, L2, “texture loss” or a combination thereof, I am not sure I would say “humans perceive to be realistic looking”. Then there are some GANs of course doing magic in lieu of coming up with an actual metric that evaluates “human perceived difference”. A more correct view could be “It produces output that was trained on minimizing differences in the pixel/feature-space”. My point being: minimizing actual human perceived differences is seldom/never done but always rather with some proxies or complex loss function constructs that make sure that no scientist has to actually deal with human observers and their preferences ;-)
- enchiridion 6y agoMaybe the answer is to use a technique like this and then put a nicer blur back on it.