Optimizing is perhaps one of the best applications of scientific reasoning in programming since the 'natural law' in this case is how the hardware actually work

Optimizing is perhaps one of the best applications of scientific reasoning in programming since the 'natural law' in this case is how the hardware actually works as opposed to whatever wrong abstraction you start with. Sometimes it is more important to be fast so in that case you know which way to go.