5 ms·
Sounds like they didn't re-do the QuestDB benchmark with same change to the indexes, and so their claim is that Clickhouse is 27x faster with a specific index t
by thegeomaster 4y ago
Sounds like they didn't re-do the QuestDB benchmark with same change to the indexes, and so their claim is that Clickhouse is 27x faster with a specific index than QuestDB without that index. Which is not a fair comparison.
Also, the tone of the post sounds really arrogant. They try to hide it a bit, I feel, but it just seeps through.
- axlee 4y agoI didn't really read it as arrogant, more as annoyed about a mischaracterization that was disparaging their product.
- SOLAR_FIELDS 4y agoIt's also part of a longer trend of saber rattling between these vendors - there's a history of these types of posts also from TimescaleDB: https://news.ycombinator.com/item?id=29096541 https://news.ycombinator.com/item?id=29096541
- qoega 4y agoThere is a small list of vendors that do not forbid to run benchmarks with their systems. https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-database https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-d... That is why there is a small subset of vendors that are being 'attacked' by this comparisons.
- bombcar 4y agoMore and more we start to see why these forbids are in place.
- Dzugaru 4y agoWell, I don't know how QuestDB works, and I couldn't find anything in the original benchmark, but probably they already have some sort of (geo)index in place? It's really strange to search geo-data by scanning the whole surface of the Earth. The point that Clickhouse outperforms this by just sorting on one axis (and even not using any fancy 2D indices) is reasonable.
- tomhallett 4y agoI was curious to hear more details about this statement - "while QuestDB utilizes its full indexing strategy to read just a tiny fraction of the actual data". Did QuestDB create indexes in their QuestDB benchmark but just not mention it? Are there geoindexes which are automatically enabled which do help (but are of less value in the general sense from Clickhouse' perspective)?
- twoodfin 4y agoI don't know how QuestDB is implemented in any detail, but this statement struck me as confused. My understanding is that for this query, QuestDB is performing a full scan of the relevant columns, and the point of the blog post was how fast their JIT engine for filtering makes this.
- olluk 4y agoNo, there are no indexes in QuestDB in the article. None. Zero. That's bold mistake in the ClickHouse article. Should be named Yes, QuestDb is Faster.
- Dzugaru 4y agoYeah, I've read more carefully and it seems they're doing full scan.
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- bastawhiz 4y agoWhy does the lack of indexes matter? Especially when the size on disk is so much higher? Defining a sensible index isn't an unreasonable or daunting task, and minimal effort in CH got a 4x speedup over QuestDB. "It's faster if you invest literally zero time making it efficient" doesn't offer any practical benefit to anyone. If it was demonstrated that Quest did a better job overall in the majority of cases where an optimization would have been missed, that's one thing. But this feels awfully nitpicky.
- deleted 4y ago[deleted]
- olluk 4y agoThere were 2 queries in the QuestDB benchmark over the same table. ClickHouse didn't even try to match both of them choosing one as a victim. I guess that's what happens when you optimise the data storage for one query.