4 ms·
Sorta, depends on your workload and if you are a solo hero dev or if you are an enterprise requiring shared data resources. For 16TB you'll definitely get bene
by sgt101 8y ago
Sorta, depends on your workload and if you are a solo hero dev or if you are an enterprise requiring shared data resources.
For 16TB you'll definitely get benefits if you are doing something embarrassingly parallel and processor bound over a cluster of a handful of machines. It's just parallelism, and it's a good thing.
I totally agree about the hundreds of Gigs - that is unless you are in a setting where many teams need to access that database and join it with others, in which case a proper data lake implemented on something beefy is a good idea. Hadoop has the benefit of distribution and replication, but another data warehouse might work better - say Oracle or Teradata if you are a small shop.