I think optimization in general is about understanding the layer of abstraction below you and arranging your workload to exploit it's efficiencies and avoid it'

I think optimization in general is about understanding the layer of abstraction below you and arranging your workload to exploit it's efficiencies and avoid it's inefficiencies. (Cases where you can reimplement using a different algorithm and end up doing less work notwithstanding.)