I wonder if a big reason is that it is very uncomfortable to move somewhere where you will be in the 1% elite of the local area. My kids would be singled out,

I wonder if a big reason is that it is very uncomfortable to move somewhere where you will be in the 1% elite of the local area. My kids would be singled out, our friends/peers would be few and far between. There would probably be few activities for the kid, and so on. This is what a high CoL area gets you.