6 ms·
There are two ways to define BigData. 1. The accumulation, integration and analysis of a larger number of data sources. 2. A volume of data that presents chal
by pfarrell 13y ago
There are two ways to define BigData.
1. The accumulation, integration and analysis of a larger number of data sources.
2. A volume of data that presents challenges running analysis functions across them... Due to the limits of the tools available.
1 is fraught with the kind of statistical pitfalls that are mentioned in the posted article. 2 describes a set of problems and boundaries that are time sensitive. What was BigData in 2006 (to, say LiveJournal or Digg) may not longer hold. As a data engineer, its important to keep a skeptical eye on marketing and make sure we're delivering valuable solutions that increase the bottom line for our business, not just produce "ain't it cool" type correlations.