3 ms·
In addition to the skeptical comments, I think infrastructure and best practice also caught up such that what used to be big data is not so big anymore. Storin
by benjaminwootton 4y ago
In addition to the skeptical comments, I think infrastructure and best practice also caught up such that what used to be big data is not so big anymore.
Storing data on S3 or using BigQuery remove a lot of the challenges as opposed to doing this stuff in the data centre. You then also have services such as EMR, Databricks and Snowflakes to acquire the tooling and platforms as an IaaS/SaaS. The actual work then moves up the stack.
Businesses are doing more with data than ever before and the volumes are growing. I just think the challenge moved on from managing large datasets as result of new tooling, infrastructure and practices.