Just curious, what did you migrate to? I think the comment "first wave of Big Data technologies" is interesting. I agree with it, but also, the term "big data

Just curious, what did you migrate to? I think the comment "first wave of Big Data technologies" is interesting. I agree with it, but also, the term "big data" is relevant to a point in time, I think. I mean, VLDB was the term before "big data" - I think when the term "big data" became popular was when technology such as Hadoop became more mainstream and available instead of just being used in special cases. I was working with terabytes of data in SQL Server prior to 2008 (around 2004/2005 - which was doable but pushing some limits) and then got into Hadoop etc. afterwards. It was interesting to reach the limits of a tech we were using and be there for the transition to Hadoop etc. There were expensive commercial alternatives - MPP databases like Teradata, Netezza or Vertica - or things like scientific computing platforms (which were very limited to scientific computing scenarios). But nothing was as.. mainstream and available as Hadoop became. And yet, Hadoop never really completely beat the traditional MPP vendors until you started getting engines like Impala, Presto, Spark etc. that made SQL on top of Hadoop easier. And that took quite a while.. in fact I'd say making SQL on top of Hadoop work well (among many other things) is probably still on-going in a way. We are much, much further along with that now than we were. On the other hand, it was interesting to see the new opportunities develop for working with data other than just SQL - straight MapReduce, machine learning, graph processing, DAG, etc. Will be interesting to see where we go from here. I still think there is a lot going on.