5 ms·
"Storage is a minor worry." For many domains, it's a big worry. I routinely encounter large, sparse datasets where I/O and storage dominate other concerns. Big
by timr 8y ago
"Storage is a minor worry."
For many domains, it's a big worry. I routinely encounter large, sparse datasets where I/O and storage dominate other concerns. Big sparse tensors are worse than the "slowness" associated with a suboptimal sparse vector math implementation.
"I think this is one of those shibboleths that separate folks who are experts in ML/data-science at scale vs those who are coming more from a enterprise/DBA background."
I've been doing ML work for a long time. This is actually a shibboleth that separates folks who mostly do image classification from other kinds of ML people.
- srean 8y ago"Minor" in the sense relatively easy to solve if not constrained by the compute needs. Interesting comment regarding image classification. I would have assumed they are the ones who don't have to worry about sparsity much. Physics, and image and video are some of the places you encounter large and dense matrices. Lapack's wet dream :)