Yes, but it's also historically associated with class too (even in the west) - the lower class had to do manual labour outdoors and thus were exposed to the sun

Yes, but it's also historically associated with class too (even in the west) - the lower class had to do manual labour outdoors and thus were exposed to the sun longer. As a result, they tended to be sun burnt and darker. Thus, dark skin was associated with lower class / poverty, and fairer skin implied that the person lead a more a sheltered life (due to their wealth).