Rights have "due process" attached to them, as you noted. This is exactly what creates violent religion called "state". My suggestion is to use "contracts" as

Rights have "due process" attached to them, as you noted. This is exactly what creates violent religion called "state". My suggestion is to use "contracts" as a basis for all social agreements. People voluntarily agree to certain behaviour between each other and "lock up" themselves in voluntary obligations. Breaking these obligations is punished by economic ostracism by others, who'd like to keep their obligations and benefits. If you steal, we will not sell you bread until you pay your debts. That simple. If some bunch of people agreed to not pollute the river and you come and pollute, they would not deal with you. If you disagree, no one kidnaps you, please feel free to negotiate and boycott back. Just like on your interview: if you don't like job conditions, you withdraw your service. But also employer withdraws his payment if he doesn't like your conditions. So you either come to some common grounds (without any need for "rights" or "morality"), or you go different ways. On a large scale it can work beautifully with internet and crypto proofs of agreements. You can have millions of people easily lock up in common agreements on intellectual property, pollution, insurance against disasters etc. Anyone willing to go against existing relations will face ostracism from millions of people absolutely automatically (via dispute resolution organizations that will act as delegates/proxies). The trick is only to grow such "contract / dispute resolution" network to a large enough scale when bullying is big economic risk. Today, people trust state to make decisions who's bad, who's good and state makes a good job to hide these people in jail and courts, so you don't even have a chance to negotiate openly. Almost no one has millions of chances to find supporters. In voluntary society you can always go to a competing agency and try to convince them that you are right and others are wrong. If they can successfully prove that to customers, they'll win the market. So what is acceptable and what is not will be decided locally by the market, never set in stone, always renegotiable to the maximum satisfaction of everyone.