4 ms·
> Except when you have large, telemetry style datasets e.g. web/product analytics which won't fit. Web analytics was one of the first applications for Greenplu
by jacques_chester 7y ago
> Except when you have large, telemetry style datasets e.g. web/product analytics which won't fit.
Web analytics was one of the first applications for Greenplum. My understanding is that Yahoo collected tens of billions of events per day in the mid-2000s.
> Or when you are trying to build a wide table and you run out of columns.
HAWQ can run SQL queries over Hadoop clusters. Clickhouse's table width is limited by how much RAM you give it.
> Or when your favourite SaaS products gives you highly nested JSON data.
This is why major databases have JSON querying capabilities and why it's been added to the next SQL standard. PostgreSQL even allows you to define indices on fields inside your JSON structures.
Better yet: decompose the highly nested data. Relational databases begin to shine when you get past at least first normal form.
> RDBMS works great up until the point that it doesn't.
RDBMSes do work great until they don't. Which means they are almost always the best solution and almost always remain so.
Folks regularly overestimate the size of their problem and underestimate the capabilities of the literally dozens of RDBMSes now available for use. Yes, it irks me.
Disclosure: I work for VMware, which sponsors Greenplum development.