3 ms·
8 core procs are dirt cheap. Dualy mobos are cheap. A quarter terabyte of ram is a couple grand. A terabyte drive costs fifty bucks. A 1000 core gpu card is a c
by elchief 13y ago
8 core procs are dirt cheap. Dualy mobos are cheap. A quarter terabyte of ram is a couple grand. A terabyte drive costs fifty bucks. A 1000 core gpu card is a couple hun.
Til you max out a box with those specs, you don't need big data.
- pfarrell 13y ago1 terabyte is definitely small data. There's only one company consistently doing big data and that's, of course, the goog. I like the dynamic definition that big data is only what is not easily handled by existing tools. The tools of the past few years (hive, cascalog, elastic search, etc) and some of the emerging ones (shark, impala, Druid, etc) have radically raised the bar for what problems smaller shops can handle. We're handling a very modest small data set (1,000 messages/sec) with just a few people. That's thanks to the awesome tools coming out of this fruitful (and overhyped) industry.