I see active beggars everyday on my way to lunch, but the word on the street is to leave me alone and not bother me. About 5 years ago, I gave one beggar some

I see active beggars everyday on my way to lunch, but the word on the street is to leave me alone and not bother me. About 5 years ago, I gave one beggar some money. This was not the first time I'd noticed him, that had been when I walked by with some shirts and he said to his buddies, "See that guy? He's in the Klan!" ('Ku Klux Klan' for non-Americans.) He's an old black guy, in his 60s, with a sense of humor. He doesn't always ask for money. He always says "hi," even shouting it from across the street. We talk about happenings in the neighborhood, sports, etc. It's just a few minutes, once or twice a week; but it's more interaction than I have with some co-workers. About a year ago, I found out that he had put the word out for no one to bother me. He figured out I can't help everyone, so he doesn't want someone ruining it for him. (I've only been asked by someone else once in the past year or so and I did help her.)