I'm plagued by fruit flies but I can't say I've ever wished them harm. Which is weird because they're incredibly annoying. I think something has to be annoying

I'm plagued by fruit flies but I can't say I've ever wished them harm. Which is weird because they're incredibly annoying. I think something has to be annoying me "on purpose" for that. And sure, I might swat at them or whatever, but that's just to make them go away.