Thanks; the way of analysing data seems like an interesting view. I do understand the consistency tradeoffs between frameworks like Hadoop and that of a databa

Thanks; the way of analysing data seems like an interesting view. I do understand the consistency tradeoffs between frameworks like Hadoop and that of a database, and that strong consistency guarantees are not required for many applications, but glad to know the range of data sizes we normally deal with. but yes, a few 100 TB does seem like a lot. :-) What kind of analysis do you do on pharmacy claims (~1.7MB per claim seems a bit high!)