To be fair, the receptors are VERY time dependent too. Take a stare at the top bar for ~20 seconds and then move your eyes down just a bit. You'll see an echo i

To be fair, the receptors are VERY time dependent too. Take a stare at the top bar for ~20 seconds and then move your eyes down just a bit. You'll see an echo image of the opposite color (colorblindness depending). This shows that even a 'little' time spent saturating the retina will effect the later images. As other people mention, the retina does a LOT of pre-processing before any 'signal' gets sent. The very first synapse from the receptor is heavily modified by horizontal and bipolar cells in a time-dependent reactive manner. The 'images' we 'see' are nothing like what the retina 'sees'. People with cataracts will commonly have very advanced occlusions before thinking there may be a problem, due to the incredible amount of processing the retina itself does. They really cannot 'see' that they cannot 'see'. So, trying to reduce vision to a color mapping is just so ... computational. Biology is not like that all the time. It's not a 'map' like with sound and hearing (where tonotopy is semi-conserved throughout brain processing). With vision, things are used as 'information' almost instantly, but for certain by the end of the LGN into V1. You can't really backtrack the data through the system once it hit V1, it self-modifies the memristance of the synapses too quickly to chase the action potentials again. So thinking of things as 'red' isn't what the brain wants to do, it's not matrix algebra. It's 'grandmother' and 'tiger' and 'that-look-in-her-eye'.