4 ms·

I can't say for sure it would help in any useful way, but it won't reduce your security to run ssh on port 1023.