3 ms·
Models never « see » anything to begin with, it’s all matrices. And since we ditched convents, locality doesn’t even matter anymore (almost). RGB is just conven
by jerpint 3y ago
Models never « see » anything to begin with, it’s all matrices. And since we ditched convents, locality doesn’t even matter anymore (almost). RGB is just convenient for humans, nothing says it’s optimal for deep learning
- IIAOPSW 3y agoYeah, real humans see with a fourier transform in a highly optimized basis for projecting 3d down to the 2d retina. Not cold soulless math like those machines! http://www.math.utah.edu/~bresslof/publications/01-3.pdf http://www.math.utah.edu/~bresslof/publications/01-3.pdf
- goldenkey 3y agoMuch hardware and software for codecs use wave basis as well. https://en.wikipedia.org/wiki/Discrete_cosine_transform https://en.wikipedia.org/wiki/Discrete_cosine_transform
- astrange 3y agoHumans see more than 8-bit RGB. Humans can see light polarization and stereo disparity, but more importantly we can interact with things we look at. XYZ is the "most optimal" 3-channel colorspace but it's a simple transformation from RGB, so it doesn't matter - the model can learn it if it wants to.