4 ms·

Your comment clearly illustrates that you have no working knowledge of Clickhouse or parquet file format or data archiving capabilities available in 2021. It's

Your comment clearly illustrates that you have no working knowledge of Clickhouse or parquet file format or data archiving capabilities available in 2021. It's OK! I was in the same boat until I needed to implement such a solution for my use case. What I'm suggesting does not limit their customers from searching any historical data. Matter of fact, it might be 100x to 1000x faster for them to do so with the suggested solution. I strongly believe that mission critical transactional databases (postgres in this case) MUST be run very lean to keep their app running at hyper speeds at all times. 50TB overhead seems very inefficient when you take into account the the low cost solutions available in this day and age. Based on my personal experience of achieving 94% compression on 2TB of data using snappy parquet file format, they could be looking at a final dataset size of 3.5TB on Clickhouse.

KptMarchewa 6y ago
>Matter of fact, it might be 100x to 1000x faster for them to do so with the suggested solution. That must be trolling. 1000x faster than single digit millisecond indexed query retrieving 15 rows? The fact that you keep talking about storage size means that you're talking about analytics not transactional needs. >Your comment clearly illustrates that you have no working knowledge of Clickhouse or parquet file format or data archiving capabilities available in 2021. It's OK! I was in the same boat until I needed to implement such a solution for my use case. Also, fuck off with that condescension.
- pupdogg 6y ago
  Ok tiger! Thank you proving that the more inept you are, the smarter you think you are. Now, go beef with someone else.
- dang 6y ago
  > fuck off with that condescension Please follow the site guidelines, regardless of whether or not someone else has broken them. Otherwise we just get a downward spiral. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
  - KptMarchewa 6y ago
    Sorry, I get way too heated when I see this type of condescending argumentation.
    - dang 6y ago
      Yes, I experience that too and I bet most people do. One way I often explain this that seems to work well is this: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=by%3Adang%20owe%20community%20better&sort=byDate&type=story&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
dang 6y ago
> Your comment clearly illustrates that you have no working knowledge Please omit swipes like that from your comments here. The rest of your comment would be find without that bit. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html

KptMarchewa 6y ago

>Matter of fact, it might be 100x to 1000x faster for them to do so with the suggested solution. That must be trolling. 1000x faster than single digit millisecond indexed query retrieving 15 rows? The fact that you keep talking about storage size means that you're talking about analytics not transactional needs. >Your comment clearly illustrates that you have no working knowledge of Clickhouse or parquet file format or data archiving capabilities available in 2021. It's OK! I was in the same boat until I needed to implement such a solution for my use case. Also, fuck off with that condescension.

pupdogg 6y ago
Ok tiger! Thank you proving that the more inept you are, the smarter you think you are. Now, go beef with someone else.
dang 6y ago
> fuck off with that condescension Please follow the site guidelines, regardless of whether or not someone else has broken them. Otherwise we just get a downward spiral. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- KptMarchewa 6y ago
  Sorry, I get way too heated when I see this type of condescending argumentation.
  - dang 6y ago
    Yes, I experience that too and I bet most people do. One way I often explain this that seems to work well is this: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=by%3Adang%20owe%20community%20better&sort=byDate&type=story&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

dang 6y ago

> Your comment clearly illustrates that you have no working knowledge Please omit swipes like that from your comments here. The rest of your comment would be find without that bit. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html