Sounds like you just need a better mechanical connection. There are silicone-filled waterproof wire nuts available. Maybe if you clean the wires and secure them

Sounds like you just need a better mechanical connection. There are silicone-filled waterproof wire nuts available. Maybe if you clean the wires and secure them with those all will be good?