You are making a lot of assumptions there and seem to think that this happens to me all the time. I don't have this problem in most conversations. To the point

You are making a lot of assumptions there and seem to think that this happens to me all the time. I don't have this problem in most conversations. To the point you're saying without the seeming antagonism - yes, you're right, a quick "wait, I think we need to talk about the background here because we're both making different assumptions" can and does work in most conversations with most people. In the worst cases, though, some people take it as "ugh, why can't they just provide a yes/no answer to my simple question!?" and the conversation can become increasingly difficult. If someone's thinking this a lot - like, they think most people are doing this to them to the extent that they wonder why "many people seem to totally lack the capability of understanding simple questions" - it would be wise for them to re-examine their assumptions.