4 ms·

I love this comment, but presumably there's a need for databases that are well suited for write heavy workloads. Also there's no great story for starting out wi

I love this comment, but presumably there's a need for databases that are well suited for write heavy workloads. Also there's no great story for starting out with an RDBMS and then scaling out. Right now if you're with MySQL you have some options to scale out with read replicas, and then eventually replicate to a TiDB cluster. PostgreSQL I guess there's cockroachdb, but it's kind of meh.

skyde 5y ago
I believe Cloudflare usage of PostgreSQL is "write heavy" and is a RDBMS that scaled out very well for them. They are using CitusDB but it's still RDBMS and support most PostgreSQL SQL query without the need to rewrite your query or change your schema.
- zinclozenge 5y ago
  That's true, I forgot about Citus.
- skyde 5y ago
  In fact Youtube for a long time was running on MySQL with a tiny service called "vitess" on top of it to handle (Sharding/partitioning) automatically. I dont know if they are still using Vitess or migrated to Google other relational Database "Spanner"
  - jeffbee 5y ago
    YouTube switched some Vitess workloads over to Procella. http://www.vldb.org/pvldb/vol12/p2022-chattopadhyay.pdf http://www.vldb.org/pvldb/vol12/p2022-chattopadhyay.pdf In general I've noticed that people outside Google assume that Spanner is much more popular than it really is.
    - jjirsa 5y ago
      Something something bigtable
    - skyde 5y ago
      To be honest I am surprised its not more popular. if you work at google and its one of the option to choose from! Is there any reason to "not" choose spanner for new project and instead use something else?
      - jeffbee 5y ago
        It's expensive.
- doliveira 5y ago
  They moved to Clickhouse recently, though: https://blog.cloudflare.com/http-analytics-for-6m-requests-per-second-using-clickhouse/ https://blog.cloudflare.com/http-analytics-for-6m-requests-p...
- deleted 5y ago
  [deleted]

4 ms·

I love this comment, but presumably there's a need for databases that are well suited for write heavy workloads. Also there's no great story for starting out wi

by zinclozenge 5y ago

skyde 5y ago
I believe Cloudflare usage of PostgreSQL is "write heavy" and is a RDBMS that scaled out very well for them. They are using CitusDB but it's still RDBMS and support most PostgreSQL SQL query without the need to rewrite your query or change your schema.
- zinclozenge 5y ago
  That's true, I forgot about Citus.
- skyde 5y ago
  In fact Youtube for a long time was running on MySQL with a tiny service called "vitess" on top of it to handle (Sharding/partitioning) automatically. I dont know if they are still using Vitess or migrated to Google other relational Database "Spanner"
  - jeffbee 5y ago
    YouTube switched some Vitess workloads over to Procella. http://www.vldb.org/pvldb/vol12/p2022-chattopadhyay.pdf http://www.vldb.org/pvldb/vol12/p2022-chattopadhyay.pdf In general I've noticed that people outside Google assume that Spanner is much more popular than it really is.
    - jjirsa 5y ago
      Something something bigtable
    - skyde 5y ago
      To be honest I am surprised its not more popular. if you work at google and its one of the option to choose from! Is there any reason to "not" choose spanner for new project and instead use something else?
      - jeffbee 5y ago
        It's expensive.
- doliveira 5y ago
  They moved to Clickhouse recently, though: https://blog.cloudflare.com/http-analytics-for-6m-requests-per-second-using-clickhouse/ https://blog.cloudflare.com/http-analytics-for-6m-requests-p...
- deleted 5y ago
  [deleted]