No, super low latency (<10ms) is only important for fast-paced games. For working, you probably don't even notice 20ms or 80ms. Anyhow, as the sister comment s

No, super low latency (<10ms) is only important for fast-paced games. For working, you probably don't even notice 20ms or 80ms. Anyhow, as the sister comment says, 5G and further advancments are bringing down latency. By the time remote work will be done in VR in a mainstream fashion, this won't be a problem at all.