Yes, and the sooner you do it the better. But doing it during project planning / experimentation phase (or when you don't know what the final result should be

Yes, and the sooner you do it the better. But doing it during project planning / experimentation phase (or when you don't know what the final result should be yet) will really just slow you down. In many ways, very similar to the static / dynamic language trade offs.