Pretty much all high end monitors have a little joystick under/behind them, have decent UI latency, and come with vendor software for changing settings without

Pretty much all high end monitors have a little joystick under/behind them, have decent UI latency, and come with vendor software for changing settings without physically touching the monitor. This is done over I2C so it should be pretty easy to reverse engineer. Try searching "monitor ddc control", it might work out of the box for your monitor