Only in the sense of having no pigment. If one were to speak in terms of genetic history I'd expect the opposite: brown would come first, and blue would be one

Only in the sense of having no pigment. If one were to speak in terms of genetic history I'd expect the opposite: brown would come first, and blue would be one of the most recent mutations.