3 ms·
I have to wonder -- considering that H3 is apparently available as a C library -- how fast it would be to simply enrich the lon/lat data with H3 data using a si
by jhgb 5y ago
I have to wonder -- considering that H3 is apparently available as a C library -- how fast it would be to simply enrich the lon/lat data with H3 data using a simple Unix filter using that C library before even importing it anywhere.
(One also wonders if the column-based database doesn't "cheat" when doing operations of the type "make a new table by adding new columns", since it could in principle COW-reuse all the unchanged columns in memory on that 70-second query.)
- qoega 5y agoClickHouse has no such optimizations for reuse of columns.
- jhgb 5y agoEven memcpy would be more that fast enough, though. This just seemed like a weird test to me since instead of testing "which [database] can convert a set of coordinates into H3 identifiers the fastest", it seems more like a test of which database can change its schema eagerly the fastest. Not saying that this is not a useful thing to have, but when you can already import data in the correct format, it seems like waste of effort for the thing allegedly being tested. (It's possible that I missed some detail, of course.)
- fhk 5y agoIndeed - https://gist.github.com/ajfriend/3eccf3ec01b33f46dc14f5dbb13d8c6f https://gist.github.com/ajfriend/3eccf3ec01b33f46dc14f5dbb13...