With moral realism, why should I care about your personal moral preferences? Whether moral statements are facts says nothing about whether your preferences are

With moral realism, why should I care about your personal moral preferences? Whether moral statements are facts says nothing about whether your preferences are the right ones. And either way, moral statements being fact isn't actually a reason to act morally since the universe only punishes you for being immoral if religion is real. What's stopping anyone from rejecting the True moral statements in favor of ones they personally prefer?