I did this many years ago with black socks and just had the unsorted drawer of socks. But unfortunately black doesn't go with everything, in particular it doesn

I did this many years ago with black socks and just had the unsorted drawer of socks. But unfortunately black doesn't go with everything, in particular it doesn't go with brown and it doesn't work at all with shorts. Since I wear both black and brown shoes, I find myself needing at least navy, black and white socks. The system then began to fall apart as I would then allow maroon socks to go with red shirts. Maybe I should start again with those four colours. It should still be easy to find them in an unsorted drawer.