4 ms·
I think everyone agrees that dynamic range compression and de-Bayering (for sensors which are colour-filtered) are necessary for digital photography, but at the
by userbinator 10mo ago
I think everyone agrees that dynamic range compression and de-Bayering (for sensors which are colour-filtered) are necessary for digital photography, but at the other end of the spectrum is "use AI to recognise objects and hallucinate what they 'should' look like" --- and despite how everyone would probably say that isn't a real photo anymore, it seems manufacturers are pushing strongly in that direction, raising issues with things like admissibility of evidence.
- stavros 10mo agoOne thing I've learned while dabbling in photography is that there are no "fake" images, because there are no "real" images. Everything is an interpretation of the data that the camera has to do, making a thousand choices along the way, as this post beautifully demonstrates. A better discriminator might be global edits vs local edits, with local edits being things like retouching specific parts of the image to make desired changes, and one could argue that local edits are "more fake" than global edits, but it still depends on a thousand factors, most importantly intent. "Fake" images are images with intent to deceive. By that definition, even an image that came straight out of the camera can be "fake" if it's showing something other than what it's purported to (e.g. a real photo of police violence but with a label saying it's in a different country is a fake photo). What most people think when they say "fake", though, is a photo that has had filters applied, which makes zero sense. As the post shows, all photos have filters applied. We should get over that specific editing process, it's no more fake than anything else.
- nospice 10mo ago> A better discriminator might be global edits vs local edits, Even that isn't all that clear-cut. Is noise removal a local edit? It only touches some pixels, but obviously, that's a silly take. Is automated dust removal still global? The same idea, just a bit more selective. If we let it slide, what about automated skin blemish removal? Depth map + relighting, de-hazing, or fake bokeh? I think that modern image processing techniques really blur the distinction here because many edits that would previously need to be done selectively by hand are now a "global" filter that's a single keypress away. Intent is the defining factor, as you note, but intent is... often hazy. If you dial down the exposure to make the photo more dramatic / more sinister, you're manipulating emotions too. Yet, that kind of editing is perfectly OK in photojournalism. Adding or removing elements for dramatic effect? Not so much.
- card_zero 10mo agoWhat's this, special pleading for doctored photos? The only process in the article that involves nearby pixels is to combine R G and B (and other G) into one screen pixel. (In principle these could be mapped to subpixels.) Everything fancier than that can be reasonably called some fake cosmetic bullshit.
- nospice 10mo agoI honestly don't understand what you're saying here.
- card_zero 10mo agoI can't see how to rephrase it. How about this: Removing dust and blemishes entails looking at more than one pixel at a time. Nothing in the basic processing described in the article does that.
- seba_dos1 10mo agoThe article doesn't even go anywhere near what you need to do in order to get an acceptable output. It only shows the absolute basics. If you apply only those to a photo from a phone camera, it will be massively distorted (the effect is smaller, but still present on big cameras).
- card_zero 10mo ago"Distorted" makes me think of a fisheye effect or something similar. Unsure if that's what you meant.
- seba_dos1 10mo agoThat's just one kind of distortion you'll see. There will also be bad pixels, lens shading, excessive noise in low light, various electrical differences across rows and temperatures that need to be compensated... Some (most?) sensors will even correct some of these for you already before handing you "raw" data. Raw formats usually carry "Bayer-filtered linear (well, almost linear) light in device-specific color space", not necessarily "raw unprocessed readings from the sensor array", although some vendors move it slightly more towards the latter than others.
- teeray 10mo ago> "Fake" images are images with intent to deceive The ones that make the annual rounds up here in New England are those foliage photos with saturation jacked. “Look at how amazing it was!” They’re easy to spot since doing that usually wildly blows out the blues in the photo unless you know enough to selectively pull those back.
- dheera 10mo agoPhotography is also an art. When painters jack up saturations in their choices of paint colors people don't bat an eyelid. There's no good reason photographers cannot take that liberty as well, and tone mapping choices is in fact a big part of photographers' expressive medium. If you want reality, go there in person and stop looking at photos. Viewing imagery is a fundamentally different type of experience.
- zmgsabst 10mo agoSure — but people reasonably distinguish between photos and digital art, with “photo” used to denote the intent to accurately convey rather than artistic expression. We’ve had similar debates about art using miniatures and lens distortions versus photos since photography was invented — and digital editing fell on the lens trick and miniature side of the issue.
- dheera 10mo agoJournalistic/event photography is about accuracy to reality, almost all other types of photography are not. Portrait photography -- no, people don't look like that in real life with skin flaws edited out Landscape photography -- no, the landscapes don't look like that 99% of the time, the photographer picks the 1% of the time when it looks surreal Staged photography -- no, it didn't really happen Street photography -- a lot of it is staged spontaneously Product photography -- no, they don't look like that in normal lighting
- BenjiWiebe 10mo ago
- xgulfie 10mo agoThere's an obvious difference between debayering and white balance vs using Photoshop's generative fill
- sho_hn 10mo agoPretending that "these two things are the same, actually" when in fact no, you can seperately name and describe them quite clearly, is a favorite pastime of vacuous content on the internet. Artists, who use these tools with clear vision and intent to achieve specific goals, strangely never have this problem.
- tpmoney 10mo agoBut that was the point the OP was making. Not that you couldn’t differentiate between white balance correction and generative fill, but rather that the intent of the change matters for determining if an image is “fake”. For example, I took a picture of my dog at the dog park the other day. I didn’t notice when framing the picture but on review at home, right smack in the middle of the lower 3rd of the photo and conveniently positioned to have your eyes led there by my dog’s pose and snout direction, was a giant, old, crusty turd. Once you noticed it, it was very hard to not see it anymore. So I broke out the photo editing tools and used some auto retouching tool to remove the turd. And lucky for me since the ground was mulch, the tool did a fantastic job of blending it out, and if I didn’t tell you it had been retouched, you wouldn’t know. Is that a fake image? The subject of the photo was my dog. The purpose of the photo was to capture my dog doing something entertaining. When I was watching the scene with my own human eyes I didn’t see the turd. Nor was capturing the turd in the photo intended or essential to capturing what I wanted to capture. But I did use some generative tool (algorithmic or AI I couldn’t say) to convincingly replace the turd with more mulch. So does doing that make the image fake? I would argue no. If you ask me what the photo is, I say it’s a photo of my dog. The edit does not change my dog, nor change the surrounding to make the dog appear somewhere else or to make the dog appear to be doing something they weren’t doing were you there to witness it yourself. I do not intend the photo to be used as a demonstration of how clean that particular dog park is or was on that day, or even to be a photo representing that dog park at all. My dog happened to be in that locale when they did something I wanted a picture of. So to me that picture is no more fake than any other picture in my library. But a pure “differentiate on the tools” analysis says it is a fake image, content that wasn’t captured by the sensor is now in the image and content that was captured no longer is. Fake image then right? I think the OP has it right, the intent of your use of the tool (and its effect) matters more than what specific tool you used.
- imiric 10mo agoI understand what you and the article are saying, but what GP is getting at, and what I agree with, is that there is a difference between a photo that attempts to reproduce what the "average" human sees, and digital processing that augments the image in ways that no human could possibly visualize. Sometimes we create "fake" images to improve clarity, detail, etc., but that's still less "fake" than smoothing skin to remove blemishes, or removing background objects. One is clearly a closer approximation of how we perceive reality than the other. So there are levels of image processing, and it would be wrong to dump them all in the same category.
- userbinator 10mo agoEverything is an interpretation of the data that the camera has to do What about this? https://news.ycombinator.com/item?id=35107601 https://news.ycombinator.com/item?id=35107601
- mrandish 10mo agoNews agencies like AP have already come up with technical standards and guidelines to technically define 'acceptable' types and degrees of image processing applied to professional photo-journalism. You can look it up because it's published on the web but IIRC it's generally what you'd expect. It's okay to do whole-image processing where all pixels have the same algorithm applied like the basic brightness, contrast, color, tint, gamma, levels, cropping, scaling, etc filters that have been standard for decades. The usual debayering and color space conversions are also fine. Selectively removing, adding or changing only some pixels or objects is generally not okay for journalistic purposes. Obviously, per-object AI enhancement of the type many mobile phones and social media apps apply by default don't meet such standards.
- mgraczyk 10mo agoI think Samsung was doing what was alleged, but as somebody who was working on state of the art algorithms for camera processing at a competitor while this was happening, this experiment does not prove what is alleged. Gaussian blurring does not remove the information, you can deconvolve and it's possible that Samsung's pre-ML super resolution was essentially the same as inverting a gaussian convolution
- userbinator 10mo agoIf you read the original source article, you'll find this important line: I downsized it to 170x170 pixels
- mgraczyk 10mo agoAnd? What algorithm was used for downsampling? What was the high frequency content of the downsampled imagine after doing a psuedo inverse with upsampling? How closely does it match the Samsung output? My point is that there IS an experiment which would show that Samsung is doing some nonstandard processing likely involving replacement. The evidence provided is insufficient to show that
- mmooss 10mo ago> What most people think when they say "fake", though, is a photo that has had filters applied, which makes zero sense. As the post shows, all photos have filters applied. Filters themselves don't make it fake, just like words themselves don't make something a lie. How the filters and words are used, whether they bring us closer or further from some truth, is what makes the difference. Photos implicitly convey, usually, 'this is what you would see if you were there'. Obviously filters can help with that, as in the OP, or hurt.
- to11mtm 10mo agoWell that's why back in the day (and even still) 'Photographer listing their whole kit for every shot' is a thing thing you sometimes see. i.e. Camera+Lens+ISO+SS+FStop+FL+TC (If present)+Filter (If present). Add focus distance if being super duper proper. And some of that is to help at least provide the right requirements to try to recreate.
- melagonster 10mo agoToday, I trust the other meaning of "fake images" is that an image was generated by AI.
- kortilla 10mo agoBut when you shift the goal posts that far, a real image has never been produced. But people very clearly want to describe when an image has been modified to represent something that didn’t happen.
- ratmeadow 10mo agoEh, I'm a photographer and I don't fully agree. Of course almost all photos these days are edited in some form. Intent is important, yes. But there are still some kinds of edits that immediately classify a photo as "fake" for me. For example if you add snow to a shot with masking or generative AI. It's fake because the real life experience was not actually snowing. You can't just hallucinate a major part of the image - that counts as fake to me. A major departure from the reality of the scene. Many other types of edits don't have this property because they are mostly based on the reality of what occurred. I think for me this comes from an intrinsic valuing of the act/craft of photography, in the physical sense. Once an image is too digitally manipulated then it's less photography and more digital art.
- bandrami 10mo agoA boss once asked me "is there a way to tell if an image has been Photoshopped?" and I did eventually get him to "yes, if you can see the image it has been digitally processed and altered by that processing". (The brand-name-as-generic conversation was saved for another day.)
- badc0ffee 10mo ago> (The brand-name-as-generic conversation was saved for another day.) Maybe don't bring that up, unless you want your boss to think you're a tedious blowhard.
- rozab 10mo agoAnother low tech example - those telephoto crowd shots that were popular during covid. The 'deception' happens before the light hits the sensor, but it's no less effective https://www.theguardian.com/australia-news/2020/sep/13/picture-imperfect-why-photos-of-crowded-beaches-may-not-be-what-they-seem https://www.theguardian.com/australia-news/2020/sep/13/pictu...
- bborud 10mo agoI agree global vs local edits as a discriminator, but there is a bit of a sliding scale here. For instance when you edit a photo of something that is lit by multiple light sources that have different color temperatures. The photo will produce a representation that shows more dramatic differences than you might be aware of when you look at the same scene. So when editing a photo, you may apply some processing to different areas to nudge the colors closer to how you’d “see” them. Ditto for black and white photos. Your visual perception has pretty high dynamic range. Not least because your eyes move and your brain creates a representation that gives you the illusion of higher dynamic range than what your eyes can actually deliver. So when you want to represent it using a technology that can only give you a fraction of the dynamic range you (or your camera) can see, you sometimes make local’ish edits (eg create a mask with brush or gradients to lighten or darken regions) Ansel Adams did a lot of dodging and burning in his prints. Some of the more famous ones are very obvious in terms of having been “processed” during the exposure of the print. I see this as overcoming the limitations in conveying what your eyes/brain will see when using the limited capabilities of camera/screen/print. It is local’ish edits, but the intent isn’t so much to deceive as it is to nudge information into a range where it can be seen/understood.
- the_af 10mo agoSidestepping the whole discussion about "fake" and "real" images, I think what matters is what degree of correlation is there, if any, between the raw sensor data and the final photo you show your friends. Raw data requires interpretation, no argument there. But when AI starts making stuff up out of nowhere, it becomes a problem. Again, some degree of making up stuff is ok, but AI often crosses the line. When it diverges enough from what was captured by the sensor, it crosses firmly into "made up" territory.
- liampulles 10mo agoML demosaicing algorithms (e.g. convolutional neural networks) are the state of the art for reversing camera color filters, and this was true back when I did my post-grad studies on the subject almost 10 years ago, not to mention all the other stages of the post-processing stack. So one will have to wrestle with the fact that some form of "AI" has been part of digital images for a while now. I mean to some degree, human perception is a hallucination of reality. It is well known by magicians that if you know the small region of space that a person is focusing on, then you can totally change other areas of the scene without the person noticing.
- grishka 10mo agoFor me personally, it's fine to do things like local tone mapping, but object segmentation is where I draw the line. As in, a camera shouldn't know what a sky or a tree or a person is. It shouldn't care about any of that. It shouldn't process different parts of the image differently depending on what it "thinks" is there. Also, denoising should be configurable, because I would always prefer noise over this stupid "painted" look.