Can someone who touts the “but it’s decentralized!!” aspects of these systems- please to explain to me how an algorithm that adjusts mining difficulty is not a

Can someone who touts the “but it’s decentralized!!” aspects of these systems- please to explain to me how an algorithm that adjusts mining difficulty is not a centralized and possibly destructive feature in control of a handful of people?