Speaking of hardware, we're entering an era where custom ASICs are becoming popular (e.g. Apple's A11 chip, Google's TPU). If we know the software libraries wo

Speaking of hardware, we're entering an era where custom ASICs are becoming popular (e.g. Apple's A11 chip, Google's TPU). If we know the software libraries won't change (blas, lapack) then what chips can we build to make them run even faster?