3 ms·

I must be misunderstanding something because from what you describe it sounds like how Gnome, i3 and EvilWM and many others handle virtual desktops.