Different people have different views of the purpose of karma, so having it not be visible will affect their voting in different ways. What you propose is one

Different people have different views of the purpose of karma, so having it not be visible will affect their voting in different ways. What you propose is one possible outcome, but another is that people stop upvoting at all. What's the point if there's no visible effect?