There has been work on using AI for this at various levels - at the neural architecture level (finding neural architectures with high throughput/latency for a g

There has been work on using AI for this at various levels - at the neural architecture level (finding neural architectures with high throughput/latency for a given hardware), at the algorithm level (finding faster matrix multiplication routines), and at the hardware level (iirc Google stated the latest version of google TPUs were partially designed with AI).