I've seen Big Data pipelines (Hive tables, Spark jobs for queries, data engineers setting it all up) for what was ultimately a 5-10 GB dataset. Companies cargo

I've seen Big Data pipelines (Hive tables, Spark jobs for queries, data engineers setting it all up) for what was ultimately a 5-10 GB dataset. Companies cargo culting Big Data stacks when their data is nowhere near big is very prevalent.