What stops a cartel from taking over in an anarchist society? I never understood how anarchists will prevent crime lords and military leaders from seizing power

What stops a cartel from taking over in an anarchist society? I never understood how anarchists will prevent crime lords and military leaders from seizing power. They certainly didn't stop that from happening in the past.