Probably part of the reason people downvote is that the button is one click away, whereas the flag button for comments is two clicks away and probably many peop

Probably part of the reason people downvote is that the button is one click away, whereas the flag button for comments is two clicks away and probably many people aren't even aware of it.