You wouldn't quite have all the latency benefits because you'd have the additional delay between when you stop speaking and when you release the button (or cut

You wouldn't quite have all the latency benefits because you'd have the additional delay between when you stop speaking and when you release the button (or cut off speech if you release too early). It wouldn't respond any faster because it's already responding at the fastest possible speed right now, it doesn't wait at all. And it wouldn't be hands free, it wouldn't feel like a natural conversation which is what I'm going for. I'd rather use speaker diarization and/or echo cancellation to solve the problem without needing the user to press any buttons.