I don't think you can know that it won't be a problem, and I would argue it's already a problem in some places. Not all sites even hide downvoted content... and

I don't think you can know that it won't be a problem, and I would argue it's already a problem in some places. Not all sites even hide downvoted content... and disagreements on subjective things will still mean even heavy moderation can't save some groups from being unwelcoming to a lot of people.