It's more than getting drawn into conversations. In a different place, where you don't know anyone, it is also more likely that you will not be annoyed by someo

It's more than getting drawn into conversations. In a different place, where you don't know anyone, it is also more likely that you will not be annoyed by someone that you have a history with with simply hearing their voice. So merely noticing the sound of 'johns' voice is enough to set you and distract and/or bother. But if you don't know 'john' it's simply not the same impact. An similar example would be my reaction to leaf blowers or lawn mowers outside my office. When they come I am always annoyed and bothered. However equally disturbing or loud (if you want to call it that) noises I typically don't care about. It's the 'hear it goes again!' that makes it (to me at least) disturbing.