Your downside I don't think applies in this case. Because it's a single application wanting to make a single reliable connection. So if there was any packet los

Your downside I don't think applies in this case. Because it's a single application wanting to make a single reliable connection. So if there was any packet loss at all it would have to stall the whole connection anyways regardless of whether it's wrapped in SSH, OpenVPN, or nothing.