zX41ZdbW

16 ms·

1. 211.▲
   by zX41ZdbW 2y ago

   I did research on that topic when implementing my project https://adsb.exposed/ The list of all data exchanges is here: https://github.com/ClickHouse/adsb.exposed/?tab=readme-ov-fi... One of the b
2. 212.▲
   RDNS Map in Your Hands (FOSDEM 2025) [video](fosdem.org)

   2 points by zX41ZdbW 2y ago|0 comments
3. 213.▲
   by zX41ZdbW 2y ago

   There is still a long road to improve database usability on semistructured data. My team has compared PostgreSQL and MongoDB on analytical queries on JSON, and the results so far have been unimpressive: https://github.com/Cl
4. 214.▲
   by zX41ZdbW 2y ago

   ClickHouse has support for trailing commas for several years. I recommend looking at ClickHouse ( https://github.com/ClickHouse/ClickHouse/ ) as an example of a modern SQL database that emphasizes developer experien
5. 215.▲
   by zX41ZdbW 2y ago

   Some examples from me: Database benchmarks: https://github.com/ClickHouse/ClickBench (containing 30+ databases) and the new JSON analytics benchmark, https://github.com/ClickHouse/JSONBench/
6. 216.▲
   by zX41ZdbW 2y ago

   Here is a way to monitor these changes in real-time: https://play.clickhouse.com/play?user=play#U0VMRUNUIGNyZWF0Z... The SQL query: SELECT created_at, 'https://github.com/'||repo_name||'&
7. 217.▲
   Kubenetmon – a Kubernetes network metering solution(github.com)

   1 points by zX41ZdbW 2y ago|0 comments
8. 218.▲
   JSONBench: Data Analytics on JSON(github.com)

   3 points by zX41ZdbW 2y ago|0 comments
9. 219.▲
   by zX41ZdbW 2y ago

   > Which was what the setting value was changed to in the patch that was eventually accepted. This means that setting help.autocorrect to 1 logically means "wait 100ms (1 decisecond) before continuing". The mistake was here. Ins
10. 220.▲
    by zX41ZdbW 2y ago

    The first rule of thumb is to never use functions from glibc (gmtime, localtime, mktime, etc) because half of them are non-thread-safe, and another half use a global mutex, and they are unreasonably slow. The second rule of thumb is to neve
11. 221.▲
    by zX41ZdbW 2y ago

    I'd like to check what is the tuple explosion problem.
12. 222.▲
    by zX41ZdbW 2y ago

    Thanks! I'm trying fish once in a while, and currently, the following are missing: $ cat <(echo "Hello") Hello $ cat <<<"Test" Test
13. 223.▲
    Decorating a Christmas Tree with the Help of Flaky Tests (2021)(clickhouse.com)

    1 points by zX41ZdbW 2y ago|0 comments
14. 224.▲
    by zX41ZdbW 2y ago

    > Relatedly, please forgive me for the embarrassing name. The name is great! PS. It's possible to make it even faster if we implement this: https://github.com/ninja-build/ninja/issues/2157 But you exp
15. 225.▲
    by zX41ZdbW 2y ago

    I have this dataset being updated in ClickHouse in real-time: https://play.clickhouse.com/play?user=play#U0VMRUNUIG1heCh0a... I also provide a way to export it or attach it to clickhouse-local and analyze it locally: https
16. 226.▲
    by zX41ZdbW 2y ago

    That is interesting, but I haven't read how it is implemented yet. The hard part is a cache layer with immediate consistency. It likely requires RAFT (or, otherwise, works incorrectly). Integration of this cache layer with S3 (offloadi
17. 227.▲
    by zX41ZdbW 2y ago

    It is actually really great! Works out of the box, does it with a single-page UI, and it is not slow. It's very close to a log viewer I always dreamed of. The UI is much better than Grafana. I connected it to the system.text_log table,
18. 228.▲
    by zX41ZdbW 2y ago

    ClickHouse uses and validates checksums for both compressed blocks of data and uncompressed data; it also checksums and validates data during network transfers. Additionally, every replica validates checksums with other replicas when doing
19. 229.▲
    by zX41ZdbW 2y ago

    This is the amount of processed data after decompression. The amount of compressed data is less. You can press whitespace during the query run to see the detailed metrics. ReadBufferFromS3Bytes 8.95 GB The amoun
20. 230.▲
    by zX41ZdbW 2y ago

    The setup in my example uses a table updated by one ClickHouse server and observed by an infinite amount of read-only replicas, which could run anywhere.
21. 231.▲
    by zX41ZdbW 2y ago

    You can store all data in ClickHouse (on S3 or on local storage); there is no need to separate historical and real-time data. To insert data into ClickHouse, you use the INSERT query to insert data as frequently as you'd like. Alternat
22. 232.▲
    by zX41ZdbW 2y ago

    It can be a wrong AWS profile in your configuration. In that case, you can correct the configuration, or use an empty server, docker container, or even CloudShell.
23. 233.▲
    by zX41ZdbW 2y ago

    You can mount read replicas on object storage in ClickHouse. Example: CREATE DATABASE test; USE test; CREATE TABLE hackernews_history UUID '66491946-56e3-4790-a112-d2dc3963e68a' ( `update_time` DateTime
24. 234.▲
    by zX41ZdbW 2y ago

    SQL has a BETWEEN AND operator: SELECT count() FROM hits WHERE EventDate BETWEEN '2024-01-01' AND '2024-11-11' https://clickhouse.com/docs/en/sql-reference/operators
25. 235.▲
    by zX41ZdbW 2y ago

    How did it go through peer review without a comparison with ClickHouse? > Our analysis shows that the Compact layout performs better when Null ratio is high and the Placeholder layout is better when the Null ratio is low or the data is s
26. 236.▲
    by zX41ZdbW 2y ago

    I have statistics about real team size behind open-source repositories, and it is exceedingly rare to be larger than 50: https://play.clickhouse.com/play?user=play#U0VMRUNUIHJlcG9fb... For comparison, my open-source product
27. 237.▲
    by zX41ZdbW 2y ago

    I insert data into ClickHouse by single records on each page view, and it is alright. The data is selectable at the same second: SELECT * FROM website_traffic WHERE time >= now() - INTERVAL 1 SECOND
28. 238.▲
    by zX41ZdbW 2y ago

    ClickHouse does not have a master replica (every replica is equal), and every machine processes inserts in parallel. It allocates block numbers through the distributed consensus in Keeper. This allows for a very high insertion rate, with se
29. 239.▲
    by zX41ZdbW 2y ago

    The good parts of DuckDB that you've mentioned, including the fact that it is a single-executable, are modeled after ClickHouse.
30. 240.▲
    by zX41ZdbW 2y ago

    > ClickHouse was designed for single-machine installations This is incorrect. ClickHouse is designed for distributed setups from the beginning, including cross-DC installations. It has been used on large production clusters even before i