I'd find a way to show what was a good comment with something besides points. Show that flag, but still hide the number of up votes. This flag would tell you

I'd find a way to show what was a good comment with something besides points. Show that flag, but still hide the number of up votes. This flag would tell you whether it was a good comment, but not exactly how good. That's what karma points do well