Depends on how important that 5% of users is to your product and your business. Also depends on whether the feature is a credibility indicator of some sort (i.e

Depends on how important that 5% of users is to your product and your business. Also depends on whether the feature is a credibility indicator of some sort (i.e., it's seldom used, but people like to know it's there and/or will think less of your product if it's not). The Pareto Principle comes into effect here. If the 5% of users adopting the feature are your most important customers, or if they're bleeding-edge users or opinion leaders to the other 95%, then it's worth keeping them appeased. On the other hand, if they're users you neither care about nor need, then consider whether the feature is extraneous -- or, worse, whether it's actually annoying the 95%.