That's good for your mac mini, but not a normal use case for a server running sshd (needing to be quiet, that is). Something that might also work for you would

That's good for your mac mini, but not a normal use case for a server running sshd (needing to be quiet, that is). Something that might also work for you would be to limit inbound access from known-trusted ip ranges, as well. Running sshd on a nonstandard port isn't in itself a bad idea (other than the potential difficulty of logging into the server later if you forget the port or something), but it shouldn't be considered a strong security measure at all.