3 ms·

Not coincidentally, the color camera's bayer filter and the pentile matrix use an awfully similar RGBG matrix arrangement. Each "pixel" you get RAW off the cam

Not coincidentally, the color camera's bayer filter and the pentile matrix use an awfully similar RGBG matrix arrangement. Each "pixel" you get RAW off the camera is only R, G, or B. The "full" resolution is synthesized in "demosaicing." In other words, 2/3s of your digital camera's image is faked up. People just don't notice much because a) the error from faking it looks a lot like defocus, b) the cameras often try to cover up their suckiness with denoising algorithms, and c) most people get a JPEG out of the camera anyway... which typically encodes the chroma (color) at a lower resolution and throws out a bunch of the fine (high-frequency) details. The real weird part is that the pentile matrix should be capable of a higher effective resolution when displaying color images from digital cameras (except from Foveon X3, 3CCD, or even more uncommon setups). It's "subpixels" are arranged the same way as the data is, which saves you from tranforming the image to and from the intermediate RGB format.

Daniel_Newby 16y ago
"the error from faking it looks a lot like defocus" Mosaic cameras tend to have an optical antialiasing filter that blurs the image, to reduce the moire effect.
- ggruschow 16y ago
  I've read this over and over again, and I can't tell if you're agreeing or disagreeing with me! Defocus spreads a point of light over more than one point in the image... as does the "antialiasing filter."
  - gjm11 16y ago
    There are actually multiple potential sources of error here. [EDIT for disambiguation: I mean error in reconstructing the image at full RGB resolution, not error in what anyone has been saying in comments here.] 1. The antialiasing filter. This behaves very much like a defocusing error. 2. Demosaicing. Exactly what this does depends on the algorithms in the camera. It doesn't necessarily look much like defocus. (For instance, on some cameras I've worked with -- not consumer ones, FWIW -- you get demosaicing artefacts that produce a sort of tartan effect.) If the antialiasing filter is strong enough that it destroys all information in the image below the Nyquist limit for the R and B photosites, then demosaicing can in principle be perfect -- i.e., lose no information that wasn't already lost by the antialiasing filter. But (a) that ceases to be true in the presence of noise in the sensor, and of course there usually is some, and (b) an antialiasing filter that strong throws away information because then you're not really using all your green photosites. So in practice, sometimes you'll get ugly high-frequency demosaicing artefacts. Presumably designing a good demosaicing algorithm is largely about making this happen as seldom as possible for real-world images.
  - Daniel_Newby 16y ago
    I don't think I was agreeing or disagreeing! Supplementing? Mosaic cameras have an optical blurring device, the antialiasing filter, between the lens and the image sensor. It throws away information, so the image will always have residual blur. Even if the demosaicing algorithm does something a bit silly, it will still look like blur.

Daniel_Newby 16y ago

"the error from faking it looks a lot like defocus" Mosaic cameras tend to have an optical antialiasing filter that blurs the image, to reduce the moire effect.

ggruschow 16y ago
I've read this over and over again, and I can't tell if you're agreeing or disagreeing with me! Defocus spreads a point of light over more than one point in the image... as does the "antialiasing filter."
- gjm11 16y ago
  There are actually multiple potential sources of error here. [EDIT for disambiguation: I mean error in reconstructing the image at full RGB resolution, not error in what anyone has been saying in comments here.] 1. The antialiasing filter. This behaves very much like a defocusing error. 2. Demosaicing. Exactly what this does depends on the algorithms in the camera. It doesn't necessarily look much like defocus. (For instance, on some cameras I've worked with -- not consumer ones, FWIW -- you get demosaicing artefacts that produce a sort of tartan effect.) If the antialiasing filter is strong enough that it destroys all information in the image below the Nyquist limit for the R and B photosites, then demosaicing can in principle be perfect -- i.e., lose no information that wasn't already lost by the antialiasing filter. But (a) that ceases to be true in the presence of noise in the sensor, and of course there usually is some, and (b) an antialiasing filter that strong throws away information because then you're not really using all your green photosites. So in practice, sometimes you'll get ugly high-frequency demosaicing artefacts. Presumably designing a good demosaicing algorithm is largely about making this happen as seldom as possible for real-world images.
- Daniel_Newby 16y ago
  I don't think I was agreeing or disagreeing! Supplementing? Mosaic cameras have an optical blurring device, the antialiasing filter, between the lens and the image sensor. It throws away information, so the image will always have residual blur. Even if the demosaicing algorithm does something a bit silly, it will still look like blur.