12 ms·
Super Resolution
- sbarre 6y agoWe talked about this a few days ago? https://news.ycombinator.com/item?id=26448986 https://news.ycombinator.com/item?id=26448986
- BiteCode_dev 6y agoSuper resolution is adding data that is not here, it's asking an algo to produce part of the art. At one point do we go from picture to painting ?
- alextheparrot 6y agoAnyone who edits photos in Lightroom understands that modern photography captures both reality and artistry. My goal when editing photos is to make them more clearly express how I felt or how I saw. This is often quite divorced from what shows up on the back screen of my camera.
- l-lousy 6y agoIt’s also very useful to be able to take a tighter crop of an existing image without worrying about pixelation
- perardi 6y agoI think photography has always been about artistry. You are taking a 2-dimensional slice of a 4-dimensional world. Interpretation is inherent. Ansel Adams was surely no stranger to post-processing. https://photofocus.com/photography/a-look-inside-ansel-adams-darkroom-magic/ https://photofocus.com/photography/a-look-inside-ansel-adams...
- wlesieutre 6y agoThat was true of film photography and development too
- pfortuny 6y agoA good experiment (which I cannot do): take a true photo of somebody, reduce it in size and then “super-resolve” it. How much must you reduce in order to produce a different “person” (or a non-person).
- Kelteseth 6y agoYou can also repeat this indefinitely: 1. Scale down 2. "Super-resolve" 3. Goto 1 In Germany, we have this game "stille post" where you whisper someone a phrase and then multiple children try to whisper the exact phrase to the next. Most of the time a completely different phrase comes out in the end.
- PEJOE 6y agoIn the US we also play the same game, but call it "Telephone."
- GeneralTspoon 6y agoAnd we call it "Chinese Whispers" in the UK
- dbrueck 6y agoYeah, although technically the goal behind things like 'super resolution' is to add data that is not there anymore but probably was there before. i.e. you had the original scene that was captured by a digital camera (a lossy operation) and then saved as an image file (often also a lossy operation), and then a tool like this makes an educated guess as to what information was lost in the 1st and 2nd steps.
- roywiggins 6y agoYou have to demosaic things anyway (as mentioned in the article) so it's not like you can escape algorithmic fudging of details.
- 6gvONxR4sf7o 6y agoPresumably you go from picture to painting the moment you open photoshop. Photography for record keeping/science and photography for aesthetics/artistry diverge long before you get to techniques like super resolution. Which is still a fuzzy boundary because anyone who has taken a picture including a sunny sky can tell you raw photos generally don't capture how it looks to your eyeballs.
- TehCorwiz 6y agoPhotography has always been more artistry than reality. From film selection, lens choice, framing and cropping, color correction, "dodging" and "burning" details in our out it's always been a compromise between what the camera sees (which itself may not be reality if you're using physical in-front-of-the-lens filters or other distortive techniques) and what the photographer want to convey. That's one of the reasons that Photographic Journalism often holds itself to ethical limitations with regards to how a photo can be manipulated after it's been taken. I'm almost certain that this kind of thing would at least walk that fine line if not fall right on over it.
- falcrist 6y agoOn one hand as Ansel Adams said "You don't take a photograph, you make it.", and that still holds true today. You're influencing the picture when you choose your camera, your lens, your sensitivity (ISO), your color mode, your white balance, your raw software, your editor, etc etc all the way from the camera to the print. On the other hand, there certainly is a difference between working with the information (pixels) you've captured, and inventing information by either drawing on the image or creating new data. This methodology falls squarely into the gray area between those two.
- diarrhea 6y agoExactly. That is also why claiming to only do "SOOC JPG" is ill-informed. People claiming it don't understand the process: to even produce a JPG, there has to be a process of interpretation already taking place. When I volunteered for a small newspaper I did my usual, sometimes significant, editing (Lightroom-level, not PS) and didn't see anything wrong with it (neither did they; of course edits look better than plain JPGs). But I can appreciate how this becomes much more important with increasing range. Imagine if Pete Souza spoiled 8 years' worth of Obama presidency imagery just because he edited them in some obscure way.
- mikepurvis 6y agoNever mind the manipulations which can occur even before the shutter is ever pressed— I'm having troubling finding links now, but I know there was controversy a few years ago about a picture of bombing rubble with an object (a dress form or something, maybe?) standing up in the middle of it, apparently by chance which created a very artistic contrast, but there were later questions about whether the photographer had in fact arranged the object in that way rather than discovering and capturing a preexisting scene. EDIT: Still can't find it, but here's a list which includes a number of other wartime photos which are proven or suspected to have been staged in various ways: https://militaryhistorynow.com/2015/09/25/famous-fakes-10-celebrated-wartime-photos-that-were-staged-edited-or-fabricated/ https://militaryhistorynow.com/2015/09/25/famous-fakes-10-ce...
- sweetheart 6y agoIt's always been more like painting than anything resembling a truthful representation of reality. In fact, the first ever photograph [1] much more closely resembles a painting than anything else, which is ironic. All advancements have simply given us more control in how painterly we render our photographs, but have never _really_ brought us closer to the truth. [1]: https://en.wikipedia.org/wiki/History_of_photography#/media/File:View_from_the_Window_at_Le_Gras_colorized_2020_new.png https://en.wikipedia.org/wiki/History_of_photography#/media/...
- sosuke 6y agoAnsel Adams answering a similar question https://youtu.be/Ml__B0l9GIs?t=1514 https://youtu.be/Ml__B0l9GIs?t=1514
- advisedwang 6y agoMy worry is when this gets used for something forensic. I imagine this will tend to reproduce things in the dataset, e.g. up-scaling blurry text may look like fonts that it has memorized more than the original. Or upscaling a feather will provide details like the feather of more common birds. Or upscaling blured out numbers will pick some numbers at random [1]. We need to make sure people don't rely on these details, e.g. in courts, HR reviews, when reddit sleuths try and investigate an incident, when someone looks for cheating partners etc. [1] https://www.theregister.com/2013/08/06/xerox_copier_flaw_means_dodgy_numbers_and_dangerous_designs/ https://www.theregister.com/2013/08/06/xerox_copier_flaw_mea...
- xadhominemx 6y agoI am not worried about it this at all. It’s not likely to randomly incriminate a real person.
- fsflover 6y agoYes, it is: https://news.ycombinator.com/item?id=26504144 https://news.ycombinator.com/item?id=26504144
- xadhominemx 6y agoOk that’s pretty far removed from a prosecutor relying on that image though
- sennight 6y agoI remember that time a guy's life got turned upside down because his fingerprints "matched" those found on a bomb. Despite the fact that he had no motive, disposition, or access - they were determined to convict, because to do otherwise would be to admit that fingerprint analysis doesn't enjoy the scientific foundation that DNA evidence does. So yeah, real people have been harmed by bad matching algorithms.
- speeder 6y agoI am from Brazil. On the first day of trials of deep-learning based facial recognition here, a random person was arrested because the algorithm confused that person with another one. Even more stupid, is that the person with "outstanding warrant" was actually ALREADY in prison. So yes, AI managed to arrest the same person, twice, one time the real person, one time a random look-alike.
- kevincox 6y agoIt is sort of. Their argument is that by taking into account the subpixel pattern of the sensor they can actually extract more detail than is readily visible in the picture. Basically you can imagine that the blue subpixel is always to the top-left of the pixel. If you shifted the blue down and right one half a pixel you would have a more "accurate" production. In this way you can add a new pixel with the blue value closer to the right spot, then interpolate the blue of the original. Of course you can also do logic such as detecting lines of different lightness and applying those on top. So yes, especially with their machine learning they are adding new detail, but that is also likely some detail that was already there, but could not be conveyed with with the lower resolution. I wonder how different this would be from the simple approach of realigning the subpixels on a higher-resolution image and interpolating the "missing" subpixels. This approach may look better but wouldn't add any data.
- ramraj07 6y agoNot true, there’s always far more data in an image than a quick glance can decipher, astronomy field obviously pioneered numerous methodologies over the decades (many of which biologists do more shittyly, speaking as a biologist who did so). In the end I’d argue a lot of these “super resolution” methods are just glorified dexonvolution, not that it’s a knock on these methods but apparently it’s not cool to call deconvolution deconvolution anymore.
- xadhominemx 6y agoNo these are not deconvolution at all. They are using AI to add information to the image.
- ramraj07 6y agoSuperresolution in consumer cameras is definitely adding detail to the image using prior information about the universe (hair has a pattern, what looks like an edge has to be sharper than what the image says, etc). This is definitely the questionable artsy aspect of this superres boom. But the question I answered was more specific which supposed how you can make up info which doesn’t exist, but that’s definitely not true either. Modern superres tech (especially the non-deep learning kind) can extract more info from the image if you systematically account for the psf of the camera, distortions etc.
- lmm 6y agoWhat makes you so confident that this "AI" doesn't end up just doing deconvolution?
- xadhominemx 6y agoBecause the images being enhanced are in focus
- nnmg 6y agoMost are, but in biology/physics STED[1] and STORM are physics based methods for overcoming the diffraction limit[2]. STED is pure physics, no math/deconvolution/AI tricks. [1] https://en.wikipedia.org/wiki/STED_microscopy https://en.wikipedia.org/wiki/STED_microscopy [2] https://en.wikipedia.org/wiki/Super-resolution_microscopy https://en.wikipedia.org/wiki/Super-resolution_microscopy
- deleted 6y ago[deleted]
- beyondcompute 6y agoI wish they now added a subscription plan or a pricing model for people who use the software several hours per month.
- rhacker 6y agoBack in the day when they first had their sub model it was soooo much cheaper than it is now :(. Here's hoping some guy that writes super-resolution ML models on the side is a big fan of Gimp.
- dwrodri 6y agoOn a semi-serious note: would GIMP accept a merge request that depends on something like LibTorch[1] or the huge binary blobs like the ones produced by TFLite? I say this as a enthusiastic hobbyist in the ML space who is always looking for productive ways to procrastinate my grad research... [1] = https://pytorch.org/tutorials/advanced/cpp_export.html https://pytorch.org/tutorials/advanced/cpp_export.html
- rhacker 6y agoI randomly just found this but I don't know if it's available or where it's hosted: https://deepai.org/publication/gimp-ml-python-plugins-for-using-computer-vision-models-in-gimp https://deepai.org/publication/gimp-ml-python-plugins-for-us... edit: https://github.com/kritiksoman/GIMP-ML https://github.com/kritiksoman/GIMP-ML
- gmiller123456 6y agoGIMP allows plugins for features that don't belong in the main application. I've found a lot of researchers had written GIMP plugins for their work, I am under the impression that that's how many of them are testing.
- lorenzhs 6y agoThere are non-Adobe alternatives with ML super-resolution features that are much cheaper. For example, Pixelmator Photo can do it for $8 (iPad, no subscription). They have a Mac version as well but I don't use macOS so I can't judge that.
- sctgrhm 6y agoIt seems like "Enhance!" is now an actual thing https://www.youtube.com/watch?v=Vxq9yj2pVWk https://www.youtube.com/watch?v=Vxq9yj2pVWk
- fastball 6y agoI just wish Adobe CC wasn't the buggiest piece of software I've ever used. I've had a number of issues over the years, but my current issue is that when I try to open CC the interface elements all freeze and are unclickable (even though the window is still scrollable – very strange behavior). So I went to uninstall it, but I can't because Photoshop is installed. So I went to uninstall Photoshop, but you guessed it, I can only uninstall PS through CC, which is unresponsive. Smh.
- taisalie 6y agoRight? Now prove you're not GPT-3 keying on the domain name.
- judge2020 6y agoThey have a tool specifically crafted to remove their buggy software: https://helpx.adobe.com/creative-cloud/kb/cc-cleaner-tool-installation-problems.html https://helpx.adobe.com/creative-cloud/kb/cc-cleaner-tool-in... Note that this isn't the same as uninstalling everything via the official process since this leaves behind stuff like Adobe's Genuine client which verifies you're not using pirated software.
- fastball 6y agoNice, thanks for the tip, will give it a go!
- medicineman 6y agoYou have to use the Adobe CC removal tool. Done that about 4 times this last year. Real PITA.
- virtualritz 6y agoIt's not only Creative Cloud itself but all the newer versions of their apps I recently used. I needed to update my CV recently and expected to spend 1h in InDesign. I spent 6h in the end. – InDesign crashes while saving and destroys my document. 1h lost. – InDesign crashes while exporting a PDF of my document (9 pages). I hadn't saved. 1h lost. – InDesign crashes (reproducible) when adding/inserting a page (mind you, that's page 10). First time this happened I hadn't saved for half an hour. I was really considering changing the text because I couldn't solve this. Then I found [1]. Quote: > [...] after speaking to Adobe chat help, they asked me to send my file to them. They sent it back to me and everything went back to normal. [...] "File was corrupted , we recovered it by using scripts and then saved as IDML." – Because of the above I had the idea of exporting to IDML. Re-importing then allowed me to add the page but I had subtle formatting errors where the last character before a tab or a newline on lines that had the font changed via a character style had the wrong style. Fixing this: 1h. – When I re-arranged parts of the CV via copy & paste entire sections I copied lost the small caps/italic styles they had assigned (acronyms/names). Going through the entire document to fix this: 1.5h. I should have known better. Less than two years ago I helped a friend do a snail mail mass mailing where we used a CSV file with addresses to create hundreds of (two page) letters. All in InDesign. Everything worked until we tried to export as PDF, for printing. The solution was to export as 'interactive' PDF and only export about ~100 pages at a time. I bought Affinity Publisher already when the thing with the letters happened. But I naively believed updating my CV would be quick in InDesign. In retrospect typesetting the CV from scratch in Publisher would have been the better choice. Last week I helped a friend with a commercial that was mostly 3D and some motion graphics done in After Effects (Ae). We couldn't get it to render in After Effects 2019. It would run out memory and then just not render the frame or crash. In the end we exported the project for an older version and went back to an Ae CC version from six years before. That worked without any issues. All this is just shocking. I used InDesign from 1.0 and it was not that bad, a decade ago. Ae ... the same. See above. As of a recent update, Acrobat Reader (free version) refuses to let me open any document w/o signing into CC first. Another wtf. What a friend of mine replied when he heard about my InDesign adventure: > I'm on CS6 for anything Adobe. Just junk now. [1] https://community.adobe.com/t5/indesign/indesign-crashes-when-adding-deleting-pages/m-p/9046300 https://community.adobe.com/t5/indesign/indesign-crashes-whe...
- ACAVJW4H 6y agoUnmesh from Piximperfect did a nice review and comparison https://www.youtube.com/watch?v=cfTbrJP5TXs https://www.youtube.com/watch?v=cfTbrJP5TXs
- ISL 6y agoPrevious discussion on the subject, five days ago: https://news.ycombinator.com/item?id=26448986 https://news.ycombinator.com/item?id=26448986
- arnaudsm 6y agoEvery time someone brings up Super-resolution, I like to pull up this hilarious example : https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-added-ryan-goslings-face-to-this-photo/ https://petapixel.com/2020/08/17/gigapixel-ai-accidentally-a... Super-resolution is only guessing. It's ok for art, not for critical tasks.
- aktuel 6y agoThere are serious use cases for super resolution in medical imaging for example.
- sgerenser 6y agoI’d think medical imaging is exactly where you wouldn’t want to use this technique. If something isn’t clear on an X-ray, you don’t want to fill in the details by guessing like this software does.
- Datenstrom 6y agoUnfortunately someone is going to wrap up super-resolution for critical tasks and sell it likely causing many people harm or at least inconvenience. I have already tried to talk some companies out of using it for police/surveillance type work. People who do not understand the technology are determined to use it and someone is going to.
- savant_penguin 6y agoWhat I find interesting about that is that after seeing the face in the super-resolution image you can kinda see it in the original
- jonplackett 6y agoEvery time someone brings up enhancing images I like to pull up this Red Dwarf clip: https://www.youtube.com/watch?v=2aINa6tg3fo https://www.youtube.com/watch?v=2aINa6tg3fo
- opo 6y ago
- turrini 6y agoHow is this different to Gigapixel AI ? https://topazlabs.com/gigapixel-ai/ https://topazlabs.com/gigapixel-ai/
- groby_b 6y agoLooking at results so far, it's strictly better. (Less noisy, less subjective errors on fine detail) If I want to up-rez strictly for printing purposes, the PS one looks like the winner. But, obviously, it's subjective.
- sosuke 6y agoI enjoyed this review https://stephenbayphotography.com/blog/adobe-super-resolution-and-topaz-gigapixel-ai/ https://stephenbayphotography.com/blog/adobe-super-resolutio... Both of the options had winners.
- zokier 6y agoThat is really good comparison, although there might bit of confirmation bias on my part there. For most parts I felt like the improvements are not really worth it compared to the artifacts when it fails. The rusty car texture is maybe the one place where it seemed to really make a distinct improvement.
- kthartic 6y agoDoes it have to be? I think the point is it's built into Adobe products now, which will be fantastic for Photoshop/Lightroom etc users. Unless ofc you're genuinely curious as to how it's different to Gigapixel and not just knocking Adobe :)
- psychomugs 6y agoA great misinterpretation of the photography is that it's an objective medium. Any combination of lenses and film stocks (or equivalent) is going to represent but a flat, skewed representation of the three-dimensional world; it's been interpreted before anyone performs any processing, computational or analog. Susan Sontag's "On Photography" is a great read on this topic for anyone marginally interested in not just photography, but art in general.
- LegitShady 6y ago>Any combination of lenses and film stocks (or equivalent) is going to represent but a flat, skewed representation of the three-dimensional world this is no different than any other sensor. It doesn't mean replacing data with guesses is better than the sensor representation of the world, which is the issue at hand today.
- strogonoff 6y agoInteresting thing’s happening here. Previously there was a clear line between scene-referred image data, which was treated as objective record of a 2D slice from a 3D world by way of measuring light, and output-referred image data—one of the countless lossy adaptations of that data to fit the limitations of some particular medium (display, paper, etc.) in order to be actually viewed. The scene- to output-referred data conversion is where objectivity inevitably went out the window, but not earlier—the original scene-referred data was mostly treated as immutable. What these guys are doing actually happens at the demosaicing stage, and from what I understand the resulting “super resolution” image is still scene-referred—but it isn’t representing the actual captured light anymore! In other words, we’ll have raw images that are partially “guesses” and no longer an objective record. This isn’t necessarily good or bad, but is somewhat of a paradigm shift I’d say. As a side note, I wish Adobe released the mechanism so that it could be made one of the demosaicing methods available in open-source raw processors, but I take it this won’t be likely.
- Rastonbury 6y agoInteresting thought, does using a physical fisheye lens that warps in different way than the eye actually sees the same using a computer-generated fisheye effect on a source image? Or any other sort of analog filter/lens that changes the picture for that matter
- natch 6y agoPixelmator Pro (happy customer here) has great superresolution without all the cloud subscription baggage. I think it’s fair to make comparisons, which I will leave to those who have CC subscriptions, but anyone doing so should realize that Adobe is being compared to a moving target as outside options and even DIY options are only getting better. Yes we’re not talking about accuracy here, just perceived resolution, no need to hammer on that.
- endlessvoid94 6y agoI agree with this. I’ve used the Pixelmator Pro feature a lot and it’s damn good. I hear it’s just monstrously fast on the M1 too.
- heroprotagonist 6y agoThis sounds like the same approach as Gigapixel AI from Topaz Labs. I haven't tried Gigapixel but I have used Topaz' Video Enhance AI, which is phenomenal. I've been using it to upscale old TV shows which never got an HD remaster, to UHD. Right now it's running through the first episode of Firefly, converting from 540p to 2160p (540p as the bluray rip was basically upscaled to 1080p from its original production, so I converted to 540p first in Handbrake with zero noticeable loss in quality since I used a near-lossless compression factor.. this provides better upscaling): https://i.imgur.com/hcRYM5n.jpg https://i.imgur.com/hcRYM5n.jpg When it's done I'll run it through Flowframes for framerate interpolation. Then maybe another pass in Handbrake to figure out an optimal size for the end file. Then I'll run through the rest of the season using the same settings I tested with this first episode.
- tokamak-teapot 6y agoIt looks like the character changed into a silk version of his shirt with no chest pocket.
- heroprotagonist 6y agoYeah, I'm not sure I have the settings quite right on this one yet. There are several AI models to choose from to get an optimal result, some of which have configurable parameters to control for this. I noticed with this model that really fine lines will have a tendency to get smoothed out a little. There's a similar model which should pull a little more detail but typically this one seems to work best. It's less noticeable once the video is in motion, compared to a still image. I also probably removed too much grain from this, hence the more 'silky' look. It's nice for skin but less so for textures.
- parhamn 6y agoThat’s cool, thanks for sharing. How long does a conversion like that usually take?
- PaulBGD_ 6y ago
- nnmg 6y agoFor anyone interested in 'real' super resolution, we use these techniques to overcome the diffraction limit in microscopy (my field is neuroscience): - https://en.wikipedia.org/wiki/Super-resolution_microscopy https://en.wikipedia.org/wiki/Super-resolution_microscopy - Stimulated emission depletion microscopy (STED): https://en.wikipedia.org/wiki/STED_microscopy https://en.wikipedia.org/wiki/STED_microscopy - stochastic optical reconstruction (PALM/STORM) - structured illumination microscopy (SIM) Here is one of my favorite STED imaging papers, looking at the skeleton of neurons: https://www.sciencedirect.com/science/article/pii/S2211124715013820 https://www.sciencedirect.com/science/article/pii/S221112471...
- fluidcruft 6y agoWow! The 3D-Sim of the nuclear envelope at the wikipedia article was amazing but seeing the structure in the neuron is astounding. Do you know how long imaging takes for this? I assume the post-processing is slow but will video be possible someday?
- nnmg 6y agoI am least familiar with SIM, but you can do live-cell SIM imaging for sure. The processing is a bit computationally intensive but not so bad (and can always be done post-hoc). The big thing you have to look out for is the light intensity killing the cells or bleaching your signals. One of our collaborators is actively working on on-the-fly SIM processing for live cell imaging. A quick glance at pubmed it looks like 11Hz was do-able several years ago https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2895555/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2895555/ and this (sorry paywalled, I've heard sci-hub has the paper...) https://pubmed.ncbi.nlm.nih.gov/30478322/ https://pubmed.ncbi.nlm.nih.gov/30478322/ STED is promising for live imaging too. Lots of beautiful pictures out there!
- kicat 6y agoYes, I'm disappointed by the name collision. Is there a tool that makes "real" superresolution photos easy? Is that built into photoshop as well under a different name?
- noahatwi 6y agoThere are many open source projects on github which achieve comparable results (with the added flexibility of being able to train your own model).
- bryanlarsen 6y agoThis sounds similar to what Nvidia's Deep Learning SuperSampling (DLSS) is doing in real time. It boggles the mind.
- sturza 6y agoCSI technology
- nailer 6y agoOne of those happy moments where science fiction becomes real: https://blog.adobe.com/hlx_ea7b90bf2b9492a9fdfdcbe74b3197ca1225aed0.jpeg https://blog.adobe.com/hlx_ea7b90bf2b9492a9fdfdcbe74b3197ca1...
- deleted 6y ago[deleted]
- Faaak 6y agofast forward 10 years, and there's a jury for a supposed crime. The only proof is an old and grainy picture taken of the suspect from far away. And then, the jury decides to use "Super resolution" to "enhance" the picture. The ML model decided that what it saw was a gun instead of a rose.
- bobsoap 6y agoFinally, reality catches up with spy movies and police-procedural TV shows.
- TheMagicHorsey 6y agoWhen I see software enhanced photography like this, and look at the relatively primitive processing that is happening on my DSLR and my high priced mirrorless cameras, I realize that despite their huge sensors and amazing glass (which I paid a small fortune for), they will soon be outclassed by the simple smartphone in my pocket. My wife routinely shoots photos on her Pixel 3 that get a better response on our family whatsapp group than the painstakingly post-processed DSLR shots I create and post. This could be an indictment of my failures as a photographer. Or perhaps my family has no taste in photos. But it's also entirely possible that a Pixel 3 is all the camera you really need for family documentary work ... and I've wasted so much money on unnecessary hobby gear.
- zokier 6y agoWell, is it a hobby, or is it family documentary? Feels like similar sentiment if you said that money spent on woodworking gear is wasted because family prefers IKEA furniture.
- TheMagicHorsey 6y agoThis is a good point to tell my wife. She wants me to sell my camera gear.
- gitpusher 6y agoENHANCE!!
- jiveturkey 6y ago> Using Super Resolution is easy — right-click on a photo (or hold the Control key while clicking normally) and c̶h̶o̶o̶s̶e̶ ̶“̶E̶n̶h̶a̶n̶c̶e̶…̶”̶ ̶f̶r̶o̶m̶ ̶t̶h̶e̶ ̶c̶o̶n̶t̶e̶x̶t̶ ̶m̶e̶n̶u̶ say "Enhance"
- zokier 6y agoI would have liked if they had more comparisons to ground truth images instead of resampled ones. The foilage and bear comparisons also look like the "super resolution" images had contrast boosted, which is either awkward artifact from the scaling or misleading post/pre-processing.
- TwoBit 6y agoRight. I wish somebody would do a proper technical analysis of this instead of all these current "well the super-res version looks good to me" reports.
- choppaface 6y agoI’ve used this a few times already and it works perfectly about 80% of the time. If your picture has a lot of grain or low-level noise it’s just going to make the noise worse, then you throw in a median to de-noise and you’ve lost the benefit. But it’s otherwise a nice tool to have, especially for older low-res photos (like 800x600 stuff you want to print). I think longer term stuff like neural rendering will make super resolution less relevant. If you can re-create a 3D scene from a single photo or otherwise reconstruct the photo in a less-resolution-dependent way, then playing the super resulting game is less interesting (for users and researchers alike).
- TwoBit 6y agoWho has old 800x600 camera raw images lying around?
- rattray 6y agoAccording to TFA, camera raw isn't required to use "Super Resolution", but regardless the answer to your question is "people who cropped their original photo".
- choppaface 6y agoI can’t get the Enhance feature to work without using the Camera Raw plugin, but yes it does work for ordinary jpegs and such. You have to open the file through Bridge. If you open Camera Raw through Photoshop (in the Filters menu) then the Enhance option doesn’t show up :P
- choppaface 6y agoI had a bunch of 25-year-old photos I wanted to print! At that res the enhancement really helps.
- jiggawatts 6y agoOne thing I've always wanted was an AI algorithm for extracting additional detail from multiple RAW camera frames of the same scene. Many photographers will typically take 10-100 shots of a subject to ensure that at least one picture is a "keeper". Keeping one frame and discarding the rest is a bit wasteful in a sense. The other frames have useful information that could be extracted by a well-trained AI to provide super-resolution, increased DoF, additional blur or shake reduction, etc... I've deliberately kept all of my RAW frames, even the not-so-sharp or slightly shaky ones, because I foresee that at some point in the future this will be an automatic thing that tools like Adobe Lightroom will do that maximise the available image quality. Storage is cheap, but I can never go back in time and photograph my memorable occasions with a better camera from the future...
- erinaceousjones 6y agoVaguely relatable, there is/was stuff like Photosynth [1] which (as far as I recall, from researching this stuff as a CS undergrad) was making use of Bundle Adjustment [2] and detecting landmarks in images using Scale Invariant Feature Transform (SIFT) [3], to estimate camera poses of photos relative to each other in a 3D scene -- even from completely different cameras. By projecting the discarded frames onto your keeper frame, you've potentially got multiple samples of the same pixels and their neigbours... (Although I guess the "every image is a plane" 3D transform is a bit simple and doesn't account for lens distortion) [1] https://en.wikipedia.org/wiki/Photosynth https://en.wikipedia.org/wiki/Photosynth [2] https://en.wikipedia.org/wiki/Bundle_adjustment https://en.wikipedia.org/wiki/Bundle_adjustment [3] https://en.wikipedia.org/wiki/Scale-invariant_feature_transform https://en.wikipedia.org/wiki/Scale-invariant_feature_transf...
- rahimiali 6y agoIf you’re having an existential crisis over interpolated/extrapolated/hallucinated images, and have been assuming that every stage of a camera throws away bits instead of interpolating, here is a list of stages in most camera pipelines that try to interpolate information already: * demosaicing: interpolates color from nearby pixels. Each pixel gets just one of the tree color components. The other two are interpolated. * decompressing jpeg: tries to guess information the compressor lost. * black field correction: adjusts the brightness at every pixel to compensate for the different sensitivity at each pixels. * de-vignetting: compensate for the border of the image being darker than the center. * auto white balance: compensates for the fact that your eye’s color consistency doesn’t work as it would in the natural setting. This is a complicated way to get you to see the color you would have you seen the full scene. All of these try to recover some aspect of the signal that was irretrievably lost by a previous step. They do this by making plausible guesses.
- biswaroop 6y agoTrue. Our brain also makes similar guesses, e.g. in the blind spot, and in most optical illusions.