I long thought that compilers are an area where deep learning could make a huge difference, with dynamic compiler construction you could even do a hardware arch

I long thought that compilers are an area where deep learning could make a huge difference, with dynamic compiler construction you could even do a hardware architecture search to find HW and instructions that is efficient after compiler optimisations, but I guess that step is sill a few years down the line. It might turn out that moving complexity to the compiler this way (instead of complex branch perdictors in HW) is the better choice.