O3 is highly optimized using generic techniques that worked in a variety of scenarios and could get papers published. Given that carefully laid out assembly can

O3 is highly optimized using generic techniques that worked in a variety of scenarios and could get papers published. Given that carefully laid out assembly can outperform by like 10x across size and speed, I think there’s a lot of headroom to play with.