Wouldn't that just end up increasing the difficulty of mining in the long term since it would all be opensource? I feel like any advantage they get by patching

Wouldn't that just end up increasing the difficulty of mining in the long term since it would all be opensource? I feel like any advantage they get by patching the software would be short lived with many people following suit, but I could 100% be wrong about that.