5 ms·
I can't help but think all this image recognition/manipulation tech being silently applied is a tad creepy. IMHO going beyond things like automatic focus/white
by userbinator 7y ago
I can't help but think all this image recognition/manipulation tech being silently applied is a tad creepy. IMHO going beyond things like automatic focus/white balance or colour adjustments, and identifying more specific things to modify, crosses the line from useful to creepy.
- viraptor 7y agoIt looks like there's a toggle https://twitter.com/flyosity/status/1146136279647772673 https://twitter.com/flyosity/status/1146136279647772673 But yes, it crosses the line where it's no longer a camera (as a feature, it does not capture reality)
- sjwright 7y agoWhat is truth? When the person on the other end of the call is looking at the image of me on their screen, the physical truth is that they're looking away from the camera, but the emotional truth is that their eyes are looking at me. When I'm chatting with loved ones, which truth is more important? Physical truth, or emotional truth? Consider for a moment that an offset front-facing camera might be just as serious a distortion of truth.
- viraptor 7y agoYou've lost me at "emotional truth". The camera captures a specific scene. The result is processed to correct for lens distortions / colour / lighting issues. But none of those changes the content. I don't think an offset camera is distorting anything. It captures the image it's expected to capture.
- LocalH 7y agoBut it doesn't capture the image the user expects it to capture - when on a Facetime call, they expect (or at least want, if they think about it at all) to be looking directly at the other parties to the call. All this is doing is correcting for that, hence "emotional truth". Reality is always shaped by our emotions and our mental state, and thus there is merit to the idea that a representation of reality that isn't 100% physically accurate can still be closer to what we perceive as reality.
- viraptor 7y agoI see where you're going, but I disagree with the "emotional truth" idea. It crosses the line for me: fixing eyes is on the same level as a gender swap or cat face filter. It modifies content and meaning and I'm against this being normalised in normal communication.
- sjwright 7y agoI don't see how the eye correction is any less of a "modification of content and meaning" than the use of an offset camera angle which it's correcting for. Just because the offset angle is currently a technical necessity and an "analogue" distortion, doesn't make it any less of a manipulation.
- viraptor 7y ago> doesn't make it any less of a manipulation. I think we've got a fundamental disagreement here. We'll just have to agree to disagree :-)
- sjwright 7y agoIn an effort to be more agreeable, I really do understand where you're coming from. I'm just openly wondering if there is a technology bias at play making stuff we're already accustomed to and which feels normal to us (e.g. cameras with rectilinear lenses capturing images from arbitrary angles) feel less manipulative than stuff which is new and technically sophisticated.
- brootstrap 7y agowhat up SJ. I have to comment on you again my friend. Why are you so passionate about this eyeball re-drawing technology? Do you video call your family and friends all the time because you live far away? Reading these conversations i'm going a bit crazy as you try to rationalize why this eyeball redrawing business is a good and necessary tech. I think it's complete trash. Is this the tech that makes apple worth billions of dollars? Not trying to stir shit up with you. just generally curious as I have an extremely opposite viewpoint. I am 28, prime millenial love to use apps and phone age. I am a huge nerd and geek (clearly as we are commenting on HN lol). I have literally never face-timed anyone except when other people are doing it and I am nearby.
- merpnderp 7y agoMaybe instead of emotional truth, how about the actual truth is that most people are actually looking the other person dead in the eye, as is appropriate for engaging with people. This camera magic just makes that more clear.
- sjwright 7y agoThe offset camera position also "changes the content" just as surely as this new process which compensates for it.
- rayiner 7y agoThe camera doesn’t capture a “scene.” It’s all just electrical impulses on a CCD. You the perform extensive processing to turn those impulses into something approximating that someone might see. It doesn’t seem a big stretch to, while you’re at it, interpret the signals in a way that reflects where the person would actually be looking. “Emotional truth” is the wrong phrase. It’s the actual truth—the person on the other side is looking at your eyes. The real issue is that the processing isn’t sophisticated enough. Instead of just moving the eyes, it should calculate what the camera would show if it were located in the screen.
- gok 7y agominor nit: Almost no camera use CCDs any more.
- LocalH 7y agoReality perception is subjective. Thus there is no true way to "capture reality".
- jrochkind1 7y agoNo camera "captures reality", ask any experienced photographer. But yeah, I think it's creepy too.
- viraptor 7y agoIt captures reality. It doesn't capture the image you see with your eyes, it distorts shapes, it messes with light, etc. But it captures the light coming in. So far we called any post-processing which changes that reality either a filter/effect or a bug. Eyes correction is as much reality as deepfakes.
- rangibaby 7y agoOn a technical level every photographic print or even SOOC jpeg has some level of image processing applied to it during development, whether analog or digital. On an artistic level: https://toinformistoinfluence.files.wordpress.com/2012/06/198398_424402037583038_642096662_n.jpg https://toinformistoinfluence.files.wordpress.com/2012/06/19...
- LocalH 7y agoI see no philosophical difference between adjusting in-camera settings (aperture, focus, white balance) and this. In both cases, you're modifying the "feel" of the image (in fact, with preprocessing, you're generally affecting the image in a wholesale manner). Digital cameras don't "capture reality", either. They scan the image over a small period of time, same as your average display in reverse. It's essentially a really fast time lapse, on the pixel level. Arguably, that's as much "not reality" as what Apple is doing here. I mean, I guess I understand the idea of "capturing reality as close as possible". I just don't see much merit in caring too much outside of an academic context. This isn't deepfakery. This is shifting eyes to provide the much needed feedback of eye contact while on a video call.
- drdeca 7y agoThere is certainly something about reality that cameras reflect, namely, that looking at the images they produce results in an approximation of seeing what one would see if one’s eye was where the camera was. I suppose that goes without saying, seeing as that is sorta what cameras are (well.. many cameras. The central examples of cameras. IR cameras don’t quite have this property, but you know what I mean.), but sometimes it is “necessary to state tautologies” (though this isn’t a tautology exactly). A linear representation of a group needn’t distinguish between every pair of group elements for me to say that it “captures” some aspect of the group.
- gok 7y agoDo you have the same complaint about automatic red-eye elimination?
- sshanky 7y agoRed-eye is induced by the flash and was never part of the reality being captured.
- chillacy 7y ago1. Engineering constraint: the camera is not as sensitive to light as humans 2. Workaround: it emits a flash which creates an undesirable side effect 3. Fix: we clean up in software Is like? 1. Engineering constraint: The camera can't be positioned behind the LCD panel the user is actually looking at 2. Workaround: it's placed 1 inch above which creates an undesirable side effect 3. Fix: we clean it up in software --- In both cases we get closer to where we'd be if the engineering constraint did not exist.
- RodoBobJon 7y agoYes, but FaceTime is not attempting to be a camera; it is attempting to simulate a face-to-face conversation. That it uses a camera is an implementation detail. The fact that the distance between the camera and the face on the screen makes it look as though the person you are conversing with isn't quite looking at you is an implementation detail leaking out of the intended abstraction.
- jasonmp85 7y ago> But yes, it crosses the line where it's no longer a camera (as a feature, it does not capture reality) This is incredibly funny.
- estebank 7y agoWhat is your opinion on the selfie wide angle correction Android does for faces? https://people.csail.mit.edu/yichangshih/wide_angle_portrait/ https://people.csail.mit.edu/yichangshih/wide_angle_portrait...
- amelius 7y agoYes, the operation should be same on all pixels, regardless of position, and regardless of the values of other pixels.
- sjwright 7y agoI know what you mean, but this is basically just correcting for a deficiency in current technology—i.e. the ability to place the front-facing camera directly behind the image of the remote person's eyeballs. The solution is a little creepy I'll admit. But the fact that we are becoming increasingly accustomed to talking to people who appear to be staring at our necks is even creepier, in my opinion.
- mcv 7y agoPhone manufacturers are trying to figure out how to make their phones as much screen as possible, while still having a front facing camera, so they have either a notch, a slide-out camera, or a hole for the camera in the screen. I propose they put that hole not in a corner, but in the middle of the screen, and position the remote person's face so that the pupil of one of their eyes is positioned exactly over the camera. That should give you the most natural interaction without distorting anything.
- dalore 7y agoEveryone would complain about the "dead pixel" in the middle of their screen.
- hermitdev 7y agoWhen I last had to replace my phone, because it fell out of my pocket exiting my car, I received a new phone, not with a dead pixel, but an entire column of dead pixels. No visible damage, straight up just powered it on after openning the box. Immediately called my phone company to request a replacement and they wanted me to buy a new phone. Said fuck that, I paid full retail for the new phone amd its defective out of the box. Send me a new phone and a prepaid shipping bill for the return.
- mkl 7y agoI don't think that's a good idea. What about the majority of the phone's use when it's not showing someone's face? What about when the person moves their head and the whole frame has to pan?
- JustSomeNobody 7y agoAt a minimum, the user should be able to turn it on and off. Edit: Just saw where someone else posted there's a toggle.
- vbuwivbiu 7y agoexactly. What other features of our faces will software "correct" next ?
- dymk 7y agoLiterally just “what a slippery slope!”
- scarejunba 7y agoMaybe they'll turn electrical signals into a picture using complex image processing that varies between sensor manufacturers. To make sure I don't get banned for being ironic, that's intended light-heartedly to say lots of processing already goes on. The tool is attempting to represent what both sender and recipient usually intend.
- dymk 7y agoWhy is this creepy?
- pradn 7y agoMy opinion is that it's not creepy. It's a simple, predictable thing.