The way I handle this problem with my web app is to quietly move highly unused features to a state where administrators can still use them but customers can't s

The way I handle this problem with my web app is to quietly move highly unused features to a state where administrators can still use them but customers can't see them. I let them hide there until I'm satisfied that there won't be a problem removing the feature permanently. I have not had a "roll back" request to date.