But then the problem is changing configs means building a new release, and needs code push access. Pretty much every config variable has env override in my apps

But then the problem is changing configs means building a new release, and needs code push access. Pretty much every config variable has env override in my apps - allows project owner to poke about in web UI without bothering me for changes.