6 ms·

Testing the Resolution of the Human Eye

29 points by brk 13y ago

jhonovich 13y ago
As the editor of the post, I'd love to get technical feedback and happy to answer any questions.
- sp332 13y ago
  Why is there a bright outline around the letters? It looks like the photos have been sharpened.
  - jhonovich 13y ago
    I am not sure what you mean by 'bright outline'. We added red rectangles around the lowest discernible line. Are you referring to that? We have not sharpened or enhanced the images. They are straight from the cameras, we simply digitally zoomed and cropped the portion of the eye chart to make it easier for people to see the results.
    - sp332 13y ago
      For example, in the "1080p - 160 lux" photo, at the bottom of the E there is a brighter line. Edit: according to my color picker, the color of the chart is generally 8e9fb9 but goes up to becae4 at the bottom of the E.
      - PavlovsCat 13y ago
        If was shot in JPEG, the camera might have sharpened it a bit before even saving the image.
- quux 13y ago
  Were the cameras saving raw images? Looks like JPEG artifacts are visible in some if the images.
- matt_kantor 13y ago
  More information about the cameras would be nice. How do their lens sizes compare to the human eye? What kind of post-processing happens in the camera (if any)? What are the characteristics of the CCDs used? Etc.
- chuckledog 13y ago
  Did all of the cameras tested have the same size lens? A physically large lens should have better low light performance, regardless of the # of megapixels.
- gagege 13y ago
  The whole experiment seemed strange. Some of the lines you said were unreadable, I could read. Also, some of the ones you said were readable, were unreadable to me. Seems pretty subjective.
- nrp 13y ago
  I hate to be negative on interesting experiments, but this test is almost useless. The noise of the sensor and the JPEG compression of the camera almost overwhelm the actual resolution in the test images. Additionally, the eye gets a larger amount of information over time during fixation, while the camera is only exposed once, with the resulting aliasing of pixels against the structure of the pattern.
- jerf 13y ago
  1. As others sugges, if you have a RAW setting on your cameras, you should use that. If you don't, you should probably get one that does. 2. I'm going to disagree with the naysayers who say this is useless. You can partially defang them by pointing out that while this doesn't fully test a camera against a human eye, it is a reasonable test on its own merits and generally answers the question that people are actually asking when they ask "what's the resolution of the human eye?" (After all, the difference in capabilities goes both ways; sure, human eyes are a great deal more sensitive on many measures, but would someone please show me their eye's 10x optical zoom? (Hello to the 2040s!)) A further observation that "megapixels" is not useful would be called for, though. We're really comparing angular resolution for a certain set of settings. But we can accept "megapixels" as a slang term if we also fix certain other camera parameters to ones common to consumer cameras in the market. 3. Using eye charts is a good idea, I think. I've seen comparisons that try to compare rod density on the human eye, but that's really hard. I'd consider adding a note that standardized eye charts measure what humans can really see rather than try to compare two extremely different hardware platforms directly.
  - jhonovich 13y ago
    We are using IP cameras, that's our area of research / focus. As such, those types of cameras so not have a raw option. We used H.264 with default quantization. We could have certainly used MJPEG, as these types of cameras support that but in our preliminary testing, it made no difference. That said, I do agree that a completely uncompressed, raw, image could make a modest difference. For our domain, IP cameras, we just don't deal with raw images.
- analog31 13y ago
  Among the many hats that I wear, one is optics designer. A useful resolution test is to take pictures of alternating black and white bars, then use some sort of image analysis software to measure the contrast ratio, then draw a graph of contrast versus "frequency" which is inversely proportional to the spacing of the bars. You could define the resolution as the frequency or spacing where contrast drops to some arbitrary value such as 50 percent. Contrast won't depend on light level unless the camera is doing some interesting post-processing. It might be worthwhile to Google "USAF test chart" and look at what pops up under Images, because folks have conjured up test patterns that are useful for determining the contrast of an imaging system in one exposure. What I think might be tricky is to come up with an objective definition of resolution or contrast that is amenable to both physical and physiological measurement. [edited to add "inversely"]
TrainedMonkey 13y ago
Very interesting. However this only tells half the story about human vision, what about color depth, dynamic vision range, and speed (flash something fast on screen)?
- jhonovich 13y ago
  Agreed. In this test, we were just looking at making out details. I would certainly not say a 10MP IP camera is equal overall to the human eye. Indeed, to the contrary, the poor low light performance of the 10MP compared to the human eye is just one example of the tradeoffs of cameras to eyes.
- sp332 13y ago
  The concepts don't map directly. The retina has a "static" contrast ratio of about 100:1 or 6.5 f-stops. However, the iris can change the amount of light that enters the eye, and the retina can change its sensitivity, so in practice it's more like 14 f-stops quickly and 20 f-stops if you let your eyes adjust for a while. That's not even counting the fact that your fovea has lots of cone cells while your peripheral vision has more rods, which is why looking next to a star makes it look brighter than looking right at it. Persistence of vision means that flashing something on the screen is almost meaningless. All that matters is how much light energy is pulsed into the eye, creating an afterimage.
- Someone 13y ago
  Half? More like 1% or less. Dynamic range is incredible (1,000,000:1 according to http://en.wikipedia.org/wiki/Human_eye#Dynamic_range http://en.wikipedia.org/wiki/Human_eye#Dynamic_range), one should test vision in darkness peripherally (rods have lower resolution, but higher sensitivity than the cones in the fovea. There are claims humans can see individual photons), etc. Even limiting one to these experiments, test subjects should dark adapt for at least one hour before a measurement (given that te article doesn't mention it, I think it is unlikely that was done). That can make a huge difference. Some (and more, including "The brain contains 10^12 neurons, 10^14 of which are in the cerebellum.") of the numbers you ask for are in http://white.stanford.edu/~brian/numbers/node2.html http://white.stanford.edu/~brian/numbers/node2.html
salient 13y ago
That's a little more than 4k (8.3MP). I think I was expecting it to be a little higher than that.
hughes 13y ago
This is misleading on several levels. The size of an image (measured in MP) has almost nothing to do with the angular resolving power of a camera, and even less to do with the resolution of the human eye. The article didn't mention that every camera tested likely has a slightly different focal length / field of view. Two cameras with the same resolution but different focal lengths will score very differently in these tests. For example, a 32mm lens will see much more detail on the chart than a 14mm lens, even with the same resolution sensor. Additionally, none of these cameras have the peripheral vision capabilities of the human eye. Our brains pick up quite a lot of information outside the tiny rectangle that these cameras are able to capture. The resolving power of the eye also changes from the center of our vision to the periphery - just because we can read the E on the chart in the middle of our eye doesn't mean we can read it from the edge of our vision. Comparing eyes to cameras at this level of simplicity is mostly meaningless.
- sp332 13y ago
  They mention that the camera has about 60-degree horizontal FOV. A 5MP 16:9 camera is about 2980x1680 pixels, so about 50 pixels per degree.
- trisweb 13y ago
  Agreed, a eye to a camera is not a comparison, I've worked for a bit in computational vision after my PhD. Our foveal vision makes the connection to digital camera sensors very unsteady. What we have is a spatial filter with diminished acuity as we move away from the focus of our vision. We're actually processing what we believe to be a small amount of information in visual cortex. By the time objects make their way up the ventral visual system, they are encoded by very specific neurons firing for just that object. The brain is also thought to fill in a huge amount of information of our visual field. You can't really leave the brain out of the equation when you estimate the sensitivity of our retina.
- robertnealan 13y ago
  Also seems to completely neglect that digital camera sensors perform wildly differently in low light situations independent of the actual image resolution.
abstrakraft 13y ago
First sentence: All sorts of wild guesses and theoretical calculations exist about what the resolution of the human eye is, with 576MP a common claim. 576MP is not a resolution. Article immediately closed.
- svachalek 13y ago
  Resolutions are commonly measured in pixels. Or are you expecting something rectangular and ISO standard like 1920 x 1080? Divide by pi, take the square root, multiply by two, we're talking about 27000 pixels in diameter. That said, I don't agree with a lot of the methodology. If pixels are what we're going for, it only makes sense to me to count rods and cones.
  - colanderman 13y ago
    No, I think the GP means angular resolution – i.e. pixels per unit of solid angle – which one might presume is the figure of merit here.
    - Dylan16807 13y ago
      It's trivial to transform the units, and it's easier to understand megapixels or xxxxp. Terrible reason to close the article.
      - colanderman 13y ago
        It's trivial to transform the units …except they're not dimensionally compatible. You need to know the solid angle subtended by those pixels. That's like saying you can trivially transform 60 miles per hour into a distance. You can't, unless you have time. More importantly, the solid angle in question is not obvious – are we talking just the fovea (area of the eye with highest density of cones [1]), the eye as a whole, or the solid area subtended by a standard computer monitor, or…? [1] http://hyperphysics.phy-astr.gsu.edu/hbase/vision/rodcone.html#c2 http://hyperphysics.phy-astr.gsu.edu/hbase/vision/rodcone.ht...
farber 13y ago
I know the tests were done by a company selling IP cameras but there are many cameras available which would make better competitors to the human eye. For instance the Leaf Aptus-II 12 which produces images with a size of 80 Megapixels.
- jhonovich 13y ago
  We do not sell any IP cameras. All we 'sell' is research and testing. Our focus is on IP cameras only, ergo the type of cameras we selected.
petercooper 13y ago
But can you see the entire line of that chart without moving your eyes at all? In terms of a single 'snapshot' of our vision, the resolution is atrociously bad. Only a very small area in the middle of our field of view has significant detail (test this by looking at some writing in the distance then stare at the first letter and try 'reading' the rest of the writing without moving your eyes - it'll just remain an indistinct blur).
- Sharlin 13y ago
  Exactly. The fovea article on Wikipedia has an illustrative diagram: http://en.wikipedia.org/wiki/Fovea_centralis http://en.wikipedia.org/wiki/Fovea_centralis
- vacri 13y ago
  If we're making it a competition, I'll note that the human eye natively supports edge detection, and it operates in a much wider range of light. Eyes also come pre-packaged in a format that allows for quite accurate determination of distance at no extra charge. While cameras have a slightly broader spectrum, eyes work in a far greater range of brightness - and seeing in the near dark is far more useful than seeing the LED on the end of a remote. Eyes are perfectly mobile, and don't require external power. Eyes have a much faster traverse and can move to and focus on a target much more quickly. If you're turning, eyes will give you a stable image of the world around you to help keep your reference - cameras will just give you motion blur. Eyes are very difficult to replace, admittedly, but they have pretty astonishing self-healing characteristics and last for decades of constant use - in the rain, snow, desert heat, even underwater (though admittedly the image isn't great). Not to mention that if you roll your cameras, people will just be confused as to your emotional state, and of course, it's harder to feel a knot of love when staring into your significant other's IP cam...
boon 13y ago
There are also algorithms that convert the raw data from the sensor into a compressed stream. That would downgrade the quality of the camera. Though, that does make me wonder if our meat software does something similar.
sukuriant 13y ago
I've been reading the comments and something stuck out to me. It's not uncommon for people to have 20/15 vision with corrective lenses. The lenses don't zoom the image in, as far as I can tell; and so, the 20/20 number we often come up with has nothing to do with the resolution of the eye as a sensor, but more to do with the focusing power of the lens. It might be more useful to consider 20/15 or 20/10 as what humans can see, since the lens is whats failing on the eye, not the sensor in the back. To that end, too, it'd be nice to see some really good glass to mitigate the lenses failings there. There are charts that relate lens sharpness to sensor acuity. As long as the lens sharpness is approximately equal or better, we should have an accurate result. Also, I have 20/15 vision with contacts in and both eyes open (weaker with just one eye open, as is normal); and, when I can see letters, I can see them pretty well defined. I'm not sure how much of that is mental post-processing, though.
tedsanders 13y ago
Fun fact: The human eye sees in higher resolution for red and green than for blue. Blue light is scattered more as it passes through the eyeball (and as an evolutionary result, blue detectors are sparser on the retina).
VladRussian2 13y ago
it is very probably that using GIMP "curves" they would be able to bring a lot of details on 5MP and 10MP "blind" images. The digital cams lack dynamic range. A "blind" dark image is very possibly somthing like this rough simplified illustration - 0 where black and 1 [out of 255] where white. To us both values look black, ie. very close to 0 vs. 255. Using a tool like "curves" one can remap 1 to say 100 while 0 is still 0 and this will frequently make a reasonable, though somewhat noisy image. Or in other words, they judged performance of camera vs. eyes by using human eyes. It would be interesting if they send the images to, for example, OCR.

29 points by brk 13y ago

jhonovich 13y ago

As the editor of the post, I'd love to get technical feedback and happy to answer any questions.

sp332 13y ago
Why is there a bright outline around the letters? It looks like the photos have been sharpened.
- jhonovich 13y ago
  I am not sure what you mean by 'bright outline'. We added red rectangles around the lowest discernible line. Are you referring to that? We have not sharpened or enhanced the images. They are straight from the cameras, we simply digitally zoomed and cropped the portion of the eye chart to make it easier for people to see the results.
  - sp332 13y ago
    For example, in the "1080p - 160 lux" photo, at the bottom of the E there is a brighter line. Edit: according to my color picker, the color of the chart is generally 8e9fb9 but goes up to becae4 at the bottom of the E.
    - PavlovsCat 13y ago
      If was shot in JPEG, the camera might have sharpened it a bit before even saving the image.
quux 13y ago
Were the cameras saving raw images? Looks like JPEG artifacts are visible in some if the images.
matt_kantor 13y ago
More information about the cameras would be nice. How do their lens sizes compare to the human eye? What kind of post-processing happens in the camera (if any)? What are the characteristics of the CCDs used? Etc.
chuckledog 13y ago
Did all of the cameras tested have the same size lens? A physically large lens should have better low light performance, regardless of the # of megapixels.
gagege 13y ago
The whole experiment seemed strange. Some of the lines you said were unreadable, I could read. Also, some of the ones you said were readable, were unreadable to me. Seems pretty subjective.
nrp 13y ago
I hate to be negative on interesting experiments, but this test is almost useless. The noise of the sensor and the JPEG compression of the camera almost overwhelm the actual resolution in the test images. Additionally, the eye gets a larger amount of information over time during fixation, while the camera is only exposed once, with the resulting aliasing of pixels against the structure of the pattern.
jerf 13y ago
1. As others sugges, if you have a RAW setting on your cameras, you should use that. If you don't, you should probably get one that does. 2. I'm going to disagree with the naysayers who say this is useless. You can partially defang them by pointing out that while this doesn't fully test a camera against a human eye, it is a reasonable test on its own merits and generally answers the question that people are actually asking when they ask "what's the resolution of the human eye?" (After all, the difference in capabilities goes both ways; sure, human eyes are a great deal more sensitive on many measures, but would someone please show me their eye's 10x optical zoom? (Hello to the 2040s!)) A further observation that "megapixels" is not useful would be called for, though. We're really comparing angular resolution for a certain set of settings. But we can accept "megapixels" as a slang term if we also fix certain other camera parameters to ones common to consumer cameras in the market. 3. Using eye charts is a good idea, I think. I've seen comparisons that try to compare rod density on the human eye, but that's really hard. I'd consider adding a note that standardized eye charts measure what humans can really see rather than try to compare two extremely different hardware platforms directly.
- jhonovich 13y ago
  We are using IP cameras, that's our area of research / focus. As such, those types of cameras so not have a raw option. We used H.264 with default quantization. We could have certainly used MJPEG, as these types of cameras support that but in our preliminary testing, it made no difference. That said, I do agree that a completely uncompressed, raw, image could make a modest difference. For our domain, IP cameras, we just don't deal with raw images.
analog31 13y ago
Among the many hats that I wear, one is optics designer. A useful resolution test is to take pictures of alternating black and white bars, then use some sort of image analysis software to measure the contrast ratio, then draw a graph of contrast versus "frequency" which is inversely proportional to the spacing of the bars. You could define the resolution as the frequency or spacing where contrast drops to some arbitrary value such as 50 percent. Contrast won't depend on light level unless the camera is doing some interesting post-processing. It might be worthwhile to Google "USAF test chart" and look at what pops up under Images, because folks have conjured up test patterns that are useful for determining the contrast of an imaging system in one exposure. What I think might be tricky is to come up with an objective definition of resolution or contrast that is amenable to both physical and physiological measurement. [edited to add "inversely"]

TrainedMonkey 13y ago

Very interesting. However this only tells half the story about human vision, what about color depth, dynamic vision range, and speed (flash something fast on screen)?

jhonovich 13y ago
Agreed. In this test, we were just looking at making out details. I would certainly not say a 10MP IP camera is equal overall to the human eye. Indeed, to the contrary, the poor low light performance of the 10MP compared to the human eye is just one example of the tradeoffs of cameras to eyes.
sp332 13y ago
The concepts don't map directly. The retina has a "static" contrast ratio of about 100:1 or 6.5 f-stops. However, the iris can change the amount of light that enters the eye, and the retina can change its sensitivity, so in practice it's more like 14 f-stops quickly and 20 f-stops if you let your eyes adjust for a while. That's not even counting the fact that your fovea has lots of cone cells while your peripheral vision has more rods, which is why looking next to a star makes it look brighter than looking right at it. Persistence of vision means that flashing something on the screen is almost meaningless. All that matters is how much light energy is pulsed into the eye, creating an afterimage.
Someone 13y ago
Half? More like 1% or less. Dynamic range is incredible (1,000,000:1 according to http://en.wikipedia.org/wiki/Human_eye#Dynamic_range http://en.wikipedia.org/wiki/Human_eye#Dynamic_range), one should test vision in darkness peripherally (rods have lower resolution, but higher sensitivity than the cones in the fovea. There are claims humans can see individual photons), etc. Even limiting one to these experiments, test subjects should dark adapt for at least one hour before a measurement (given that te article doesn't mention it, I think it is unlikely that was done). That can make a huge difference. Some (and more, including "The brain contains 10^12 neurons, 10^14 of which are in the cerebellum.") of the numbers you ask for are in http://white.stanford.edu/~brian/numbers/node2.html http://white.stanford.edu/~brian/numbers/node2.html

salient 13y ago

That's a little more than 4k (8.3MP). I think I was expecting it to be a little higher than that.

hughes 13y ago

This is misleading on several levels. The size of an image (measured in MP) has almost nothing to do with the angular resolving power of a camera, and even less to do with the resolution of the human eye. The article didn't mention that every camera tested likely has a slightly different focal length / field of view. Two cameras with the same resolution but different focal lengths will score very differently in these tests. For example, a 32mm lens will see much more detail on the chart than a 14mm lens, even with the same resolution sensor. Additionally, none of these cameras have the peripheral vision capabilities of the human eye. Our brains pick up quite a lot of information outside the tiny rectangle that these cameras are able to capture. The resolving power of the eye also changes from the center of our vision to the periphery - just because we can read the E on the chart in the middle of our eye doesn't mean we can read it from the edge of our vision. Comparing eyes to cameras at this level of simplicity is mostly meaningless.

sp332 13y ago
They mention that the camera has about 60-degree horizontal FOV. A 5MP 16:9 camera is about 2980x1680 pixels, so about 50 pixels per degree.
trisweb 13y ago
Agreed, a eye to a camera is not a comparison, I've worked for a bit in computational vision after my PhD. Our foveal vision makes the connection to digital camera sensors very unsteady. What we have is a spatial filter with diminished acuity as we move away from the focus of our vision. We're actually processing what we believe to be a small amount of information in visual cortex. By the time objects make their way up the ventral visual system, they are encoded by very specific neurons firing for just that object. The brain is also thought to fill in a huge amount of information of our visual field. You can't really leave the brain out of the equation when you estimate the sensitivity of our retina.
robertnealan 13y ago
Also seems to completely neglect that digital camera sensors perform wildly differently in low light situations independent of the actual image resolution.

abstrakraft 13y ago

First sentence: All sorts of wild guesses and theoretical calculations exist about what the resolution of the human eye is, with 576MP a common claim. 576MP is not a resolution. Article immediately closed.

svachalek 13y ago
Resolutions are commonly measured in pixels. Or are you expecting something rectangular and ISO standard like 1920 x 1080? Divide by pi, take the square root, multiply by two, we're talking about 27000 pixels in diameter. That said, I don't agree with a lot of the methodology. If pixels are what we're going for, it only makes sense to me to count rods and cones.
- colanderman 13y ago
  No, I think the GP means angular resolution – i.e. pixels per unit of solid angle – which one might presume is the figure of merit here.
  - Dylan16807 13y ago
    It's trivial to transform the units, and it's easier to understand megapixels or xxxxp. Terrible reason to close the article.
    - colanderman 13y ago
      It's trivial to transform the units …except they're not dimensionally compatible. You need to know the solid angle subtended by those pixels. That's like saying you can trivially transform 60 miles per hour into a distance. You can't, unless you have time. More importantly, the solid angle in question is not obvious – are we talking just the fovea (area of the eye with highest density of cones [1]), the eye as a whole, or the solid area subtended by a standard computer monitor, or…? [1] http://hyperphysics.phy-astr.gsu.edu/hbase/vision/rodcone.html#c2 http://hyperphysics.phy-astr.gsu.edu/hbase/vision/rodcone.ht...

farber 13y ago

I know the tests were done by a company selling IP cameras but there are many cameras available which would make better competitors to the human eye. For instance the Leaf Aptus-II 12 which produces images with a size of 80 Megapixels.

jhonovich 13y ago
We do not sell any IP cameras. All we 'sell' is research and testing. Our focus is on IP cameras only, ergo the type of cameras we selected.

petercooper 13y ago

But can you see the entire line of that chart without moving your eyes at all? In terms of a single 'snapshot' of our vision, the resolution is atrociously bad. Only a very small area in the middle of our field of view has significant detail (test this by looking at some writing in the distance then stare at the first letter and try 'reading' the rest of the writing without moving your eyes - it'll just remain an indistinct blur).

Sharlin 13y ago
Exactly. The fovea article on Wikipedia has an illustrative diagram: http://en.wikipedia.org/wiki/Fovea_centralis http://en.wikipedia.org/wiki/Fovea_centralis
vacri 13y ago
If we're making it a competition, I'll note that the human eye natively supports edge detection, and it operates in a much wider range of light. Eyes also come pre-packaged in a format that allows for quite accurate determination of distance at no extra charge. While cameras have a slightly broader spectrum, eyes work in a far greater range of brightness - and seeing in the near dark is far more useful than seeing the LED on the end of a remote. Eyes are perfectly mobile, and don't require external power. Eyes have a much faster traverse and can move to and focus on a target much more quickly. If you're turning, eyes will give you a stable image of the world around you to help keep your reference - cameras will just give you motion blur. Eyes are very difficult to replace, admittedly, but they have pretty astonishing self-healing characteristics and last for decades of constant use - in the rain, snow, desert heat, even underwater (though admittedly the image isn't great). Not to mention that if you roll your cameras, people will just be confused as to your emotional state, and of course, it's harder to feel a knot of love when staring into your significant other's IP cam...

boon 13y ago

There are also algorithms that convert the raw data from the sensor into a compressed stream. That would downgrade the quality of the camera. Though, that does make me wonder if our meat software does something similar.

sukuriant 13y ago

I've been reading the comments and something stuck out to me. It's not uncommon for people to have 20/15 vision with corrective lenses. The lenses don't zoom the image in, as far as I can tell; and so, the 20/20 number we often come up with has nothing to do with the resolution of the eye as a sensor, but more to do with the focusing power of the lens. It might be more useful to consider 20/15 or 20/10 as what humans can see, since the lens is whats failing on the eye, not the sensor in the back. To that end, too, it'd be nice to see some really good glass to mitigate the lenses failings there. There are charts that relate lens sharpness to sensor acuity. As long as the lens sharpness is approximately equal or better, we should have an accurate result. Also, I have 20/15 vision with contacts in and both eyes open (weaker with just one eye open, as is normal); and, when I can see letters, I can see them pretty well defined. I'm not sure how much of that is mental post-processing, though.

tedsanders 13y ago

Fun fact: The human eye sees in higher resolution for red and green than for blue. Blue light is scattered more as it passes through the eyeball (and as an evolutionary result, blue detectors are sparser on the retina).

VladRussian2 13y ago

it is very probably that using GIMP "curves" they would be able to bring a lot of details on 5MP and 10MP "blind" images. The digital cams lack dynamic range. A "blind" dark image is very possibly somthing like this rough simplified illustration - 0 where black and 1 [out of 255] where white. To us both values look black, ie. very close to 0 vs. 255. Using a tool like "curves" one can remap 1 to say 100 while 0 is still 0 and this will frequently make a reasonable, though somewhat noisy image. Or in other words, they judged performance of camera vs. eyes by using human eyes. It would be interesting if they send the images to, for example, OCR.