For me it's the opposite, when walking around I'll have a sense where "north" or "home" is, and at some point it will switch (north becoming east for example) a

For me it's the opposite, when walking around I'll have a sense where "north" or "home" is, and at some point it will switch (north becoming east for example) and I won't notice it.