3 ms·
I think the way it'll go is: it'll be implemented in Fotran, BLAS and so on until it percolates to numpy / CUDA so mortals like us can use it.
by ovi256 6y ago
I think the way it'll go is: it'll be implemented in Fotran, BLAS and so on until it percolates to numpy / CUDA so mortals like us can use it.
- MPSimmons 6y agoAgree. I don't think we'll notice, but the next gen of CUDA will be better because of it.
- amluto 6y agoThese particular algorithms tend to have large Constance factors, so you need astronomically large matrices before they become faster than algorithms with worse exponents but better constant factors.
- ovi256 6y agoHopefully the matmul implementation can check matrix size and pick the algorithm to use from that. I think some may already do this.