4 ms·

While explaining the feature in the presentation, Phil Schiller explained that it did face detection to find the foreground. In addition, the camera mode is cal

by scarlac 10y ago

While explaining the feature in the presentation, Phil Schiller explained that it did face detection to find the foreground. In addition, the camera mode is called "Portrait" in the Camera app. While it is still speculation until next week, I think it's reasonable to be skeptic about its ability to use produce bokeh on images with no detected faces. Presentation: https://youtu.be/NS0txu_Kzl8?t=1h12m25s https://youtu.be/NS0txu_Kzl8?t=1h12m25s

jychang 10y ago
> While it is still speculation until next week, I think it's reasonable to be skeptic about its ability to use produce bokeh on images with no detected faces. That shouldn't be a limitation in the technology though, just a implementation detail. Emulating DoF would work whether you have a face in the photo or not, it's just easier to lock on to a face as your primary focus.
- achow 10y ago
  I'm not so sure. I was thinking that this would be interesting for product photography but not sure whether it would work. For example, if I'm shooting a row of coffee cups for the side (diagonally) but want the front cup to be in focus and rest in the row gradually going out of focus. [Edit] The point being Apple uses algorithm to detect face to 'compute' the depth of field - would the same work for any random object? I'm not sure about this.
- Jack000 10y ago
  stereo depth still has a lot of issues - eg. if you're shooting a white wall or other feature-less object. Not sure if they have better algos but if you use an off-the-shelf stereo package from OpenCV or ROS there are lots of holes in the depth map even in ideal cases. They probably focus on the portrait application because it has the least amount of corner cases.
- joemi 10y ago
  I'm thinking that if they still let you tap to select what to base the brightness on in this mode, they might be able to extend that to the focus so that it can work with non-face photos. Keep the part you tap on in focus (and anything else at that distance), blur the rest. Though that might not allow you to do independent brightness... Hmmm... Anyway, it's pure hope/speculation at this point.
svckr 10y ago
Thanks for clarifying that. I was slightly irritated as the article name-dropped bokeh but then went on raving about the processor, not coming back to bokeh to pick up the dangling reference. So the iPhone just blurs what it considers the background in post-processing? This sounds like it just might work if done right. I think I'd still wish for manual focus though :)
joemi 10y ago
Thanks. I don't watch the presentations anymore, so I hadn't heard about that. I think you're right that it's reasonable to be skeptical, but it may also just prove to be an implementation detail. But with the info we have now, yup, sound like it's just for portraits.

by scarlac 10y ago

jychang 10y ago

> While it is still speculation until next week, I think it's reasonable to be skeptic about its ability to use produce bokeh on images with no detected faces. That shouldn't be a limitation in the technology though, just a implementation detail. Emulating DoF would work whether you have a face in the photo or not, it's just easier to lock on to a face as your primary focus.

achow 10y ago
I'm not so sure. I was thinking that this would be interesting for product photography but not sure whether it would work. For example, if I'm shooting a row of coffee cups for the side (diagonally) but want the front cup to be in focus and rest in the row gradually going out of focus. [Edit] The point being Apple uses algorithm to detect face to 'compute' the depth of field - would the same work for any random object? I'm not sure about this.
Jack000 10y ago
stereo depth still has a lot of issues - eg. if you're shooting a white wall or other feature-less object. Not sure if they have better algos but if you use an off-the-shelf stereo package from OpenCV or ROS there are lots of holes in the depth map even in ideal cases. They probably focus on the portrait application because it has the least amount of corner cases.
joemi 10y ago
I'm thinking that if they still let you tap to select what to base the brightness on in this mode, they might be able to extend that to the focus so that it can work with non-face photos. Keep the part you tap on in focus (and anything else at that distance), blur the rest. Though that might not allow you to do independent brightness... Hmmm... Anyway, it's pure hope/speculation at this point.

svckr 10y ago

Thanks for clarifying that. I was slightly irritated as the article name-dropped bokeh but then went on raving about the processor, not coming back to bokeh to pick up the dangling reference. So the iPhone just blurs what it considers the background in post-processing? This sounds like it just might work if done right. I think I'd still wish for manual focus though :)

joemi 10y ago

Thanks. I don't watch the presentations anymore, so I hadn't heard about that. I think you're right that it's reasonable to be skeptical, but it may also just prove to be an implementation detail. But with the info we have now, yup, sound like it's just for portraits.