That's a good point, though you could use some firewall rules to rewrite the port number so that the local daemon is listening on the normal port but accessible

That's a good point, though you could use some firewall rules to rewrite the port number so that the local daemon is listening on the normal port but accessible via an alternate high numbered port.