4 ms·
Awesome to see tech like numba being used like this. Are you guys going to write a more 'techy' version of how you accomplish all of this?
by Fede_V 13y ago
Awesome to see tech like numba being used like this. Are you guys going to write a more 'techy' version of how you accomplish all of this?
- vtuulos 13y agoYes, definitely. We might be able to open-source some parts of the system eventually as well.
- Fede_V 13y agoExcellent. For sparse storage, do you use Scipy Sparse, or you have your own custom built solution? I know continuum was working on a version of memmapped numpy (blaze, iirc) arrays which looked really interesting.
- vtuulos 13y agoI started with Scipy Sparse. I ditched it for a custom solution so I could support variable-length integers, run-length encoding etc.
- pwang 13y agoGood work Ville, let me know when you post those slides/writeup. :-)
- vtuulos 13y agoThanks Peter! Let me know if you happen to visit SF. It would be nice to catch up.