4 ms·
Ask HN: What is the complexity of the typical data that you work with?
Granted that it is very difficult to measure data complexity, I refer to the four dimensions of data defined by the 'Big Data Commission'.
1. Volume: The sheer amount of data generated or data intensity that must be ingested, analyzed, and managed to make decisions based on complete data analysis
2. Velocity: How fast data is being produced and changed and the speed with which data must be received, understood, and processed
3. Variety: Structured, unstructured, semistructured
4. Veracity: The quality and provenance of received/produced data
- perfmode 9y ago2TB of structured, epigenetic data increasing at rate of 50GB/week