4 ms·
In addition to compression, let's not forget sampling. For a lot of problems a random subset of the data will give you a statistically meaningful answer with su
by pge 13y ago
In addition to compression, let's not forget sampling. For a lot of problems a random subset of the data will give you a statistically meaningful answer with sufficient precision. It seems like the rise of "big data" has led to the assumption that all queries have to be run against the entire dataset.
- disgruntledphd2 13y agoTrue. The issue with "Big Data" is that sometimes, especially when you need to produce personalised recommendations, the sampling doesn't cut it (or at least produces sub-optimal results).