While I do agree on the humility and lack of understanding points, my perspective is more, that the current solution is probably not the best, but what the best

While I do agree on the humility and lack of understanding points, my perspective is more, that the current solution is probably not the best, but what the best solution would be is pretty much unknowable for any non trivial system. Instead, it is more likely that you are approaching a local maxima. So the question is, whether it makes more sense to optimize your current approach or seeking another maxima which implies making things worse for a while before they get better and you might get stuck halfway there. Either way might be a better choice for a given situation and due to lack of information and changing environments carry their own risks.