Never said EVERY data set fits in RAM, but that doesn't mean MOST of them don't. There is a trend, when the application is inefficient, to spend huge amount of

Never said EVERY data set fits in RAM, but that doesn't mean MOST of them don't. There is a trend, when the application is inefficient, to spend huge amount of resources on scaling it instead of making the application more efficient.