That's what Matter is supposed to do, and why all of the various smart home vendors seem to be jumping aboard. To your point of "stuck with HA as a controller"

That's what Matter is supposed to do, and why all of the various smart home vendors seem to be jumping aboard. To your point of "stuck with HA as a controller" that's not entirely true, if you're an Apple household, install the HomeKit bridge and expose things to homekit where you can automate to your hearts content.