4 ms·
I'm eagerly awaiting their sparse matrix support. It's unbelievable that the entire JVM doesn't have a single comprehensive, production quality sparse matrix li
by lenticular 7y ago
I'm eagerly awaiting their sparse matrix support. It's unbelievable that the entire JVM doesn't have a single comprehensive, production quality sparse matrix library [0]. This is one of the big things keeping my machine learning in Python.
- lixtra 7y agoCan't you use JNI with the usual C/FORTRAN-libs? That's AFIAK what python does [1]. Or are you asking for a nicer wrapper? [1] https://markus-beuckelmann.de/blog/boosting-numpy-blas.html https://markus-beuckelmann.de/blog/boosting-numpy-blas.html
- lenticular 7y agoSure, but there's not a single mature library that's done so.
- sooheon 7y agoCheck out Neanderthal[0], it seems to have support for some subset of sparse matrices and it's faster than ND4J[1] to boot. [0]: https://neanderthal.uncomplicate.org https://neanderthal.uncomplicate.org [1]: https://dragan.rocks/articles/18/Neanderthal-vs-ND4J-vol1 https://dragan.rocks/articles/18/Neanderthal-vs-ND4J-vol1
- lenticular 7y agoYeah, Neanderthal is great (I'm a Clojure a user). It's got support for structured sparse matrices (like Toeplitz) the last I checked, but not general CSC/CSR matrices.
- walkingolof 7y agoI'm by no means a expert in the field, but I've used https://github.com/scalanlp/breeze https://github.com/scalanlp/breeze for this....
- lenticular 7y agoBreeze runs out of memory for even surprisingly small arrays.