3 ms·
Elasticsearch is massively more powerful and flexible. The way I'm doing aggregation counts on top of PostgreSQL is very unlikely to scale to millions of docum
by simonw 9y ago
Elasticsearch is massively more powerful and flexible.
The way I'm doing aggregation counts on top of PostgreSQL is very unlikely to scale to millions of documents. Elasticsearch pretty much acts as a real-time, horizontally scalable map/reduce engine so expensive aggregations get executed on multiple shards and the results are gathered back together.
You may find my talk from DjangoCon this year interesting: https://speakerdeck.com/simon/the-denormalized-query-engine-design-pattern https://speakerdeck.com/simon/the-denormalized-query-engine-... / https://www.youtube.com/watch?v=NzcvewgqYog https://www.youtube.com/watch?v=NzcvewgqYog
- StavrosK 9y agoWhat type of data is ES good for? It's more than documents and full-text search, if I'm not mistaken, correct?
- bebop 9y agoI have used it as a general data store, where I can accept eventual consistency. It is a very good distributed db if you are ok with the trade offs it imposes, mostly non-atomic commits to your cluster.
- othersideofcoin 9y agoIt also excels at storing logs for later aggregation and analysis.
- StavrosK 9y agoThank you, I was specifically wondering how good it is at data ingestion for warehousing. Good to know that's one of its strengths.