> The part of this that I don't understand is: since we will always know more information later in time, why not defer such decisions until runtime? Latency v

> The part of this that I don't understand is: since we will always know more information later in time, why not defer such decisions until runtime? Latency vs Throughput. And cost of optimizations vs win of optimization.