Don't really have an answer for any of your other points, but at least for 1), have you considered Fortran (90)? The language is built for linear algebra and ma

Don't really have an answer for any of your other points, but at least for 1), have you considered Fortran (90)? The language is built for linear algebra and mathematical computing, and matrix multiplication that makes sense comes out of the box with it.