You can get a switch that lets you select between HDMI signals, and quick-disconnect magnetic USB cables, that's how I deal with this problem. Realistically I

You can get a switch that lets you select between HDMI signals, and quick-disconnect magnetic USB cables, that's how I deal with this problem. Realistically I don't switch it more than once a day; during work hours I don't need my personal machine and away from work hours I (generally) don't need my work machine.