Without a high karma score, how are you supposed to downvote comments? You can't have certain features unlocked by karma and then tell people not to care about

Without a high karma score, how are you supposed to downvote comments? You can't have certain features unlocked by karma and then tell people not to care about their score.