It's already a problem. Go look at the history tab for any moderately large town in OSM. You'll find gigantic edits overlapping the area you're trying to look a

It's already a problem. Go look at the history tab for any moderately large town in OSM. You'll find gigantic edits overlapping the area you're trying to look at. The reason for that is someone posting changes/additions onto map locations on separate countries and/or continents, so it intersects with your small town regardless if the changes were near it. Those edits are usually people adding useless businesses and phone-numbers. I've seen people advertising bitcoin-related business and general spam.