Using "big data" technology is more than just an factor of input size. If your operations making the data bigger, you might well need a bigger tool. You can sta

Using "big data" technology is more than just an factor of input size. If your operations making the data bigger, you might well need a bigger tool. You can start with a data set on the middle-to-high-end of memory-sized, but if you have an operation in there which combinatorially explodes the input data, Spark is going to start looking pretty good.