5 ms·

Does anyone have insight or experience using this in production? We're currently running PostgreSQL 10 w/ pg_partman on our own hardware but looking at a severa

by kdv 8y ago

Does anyone have insight or experience using this in production? We're currently running PostgreSQL 10 w/ pg_partman on our own hardware but looking at a several options for cloud migration. Unfortunately, Citus Cloud on GCP doesn't appear to be an option (yet?) - Google Cloud SQL (PostgreSQL) - Citus Cloud (AWS Only) - Citus (managed ourselves) on GCP

alexnewman 8y ago
citus isn't simply postgresql. It has many tradeoffs
- kdv 8y ago
  We get that, but I left off (for brevity) the reasons why Citus would be a net positive for our use case.
  - ivanr 8y ago
    I would appreciate if you could list some of those differences and tradeoffs, for some of us who are interested in Citus but haven't yet had time to look at it in more detail. Thanks!
- manigandham 8y ago
  What do you mean? It's just an extension to PostgreSQL and runs anywhere that allows you to load it.
manigandham 8y ago
We did, but now use https://aiven.io https://aiven.io Highly recommended if you want a fast and featured managed db service.
- misterbowfinger 8y ago
  what's the benefit of using them vs. AWS or GCP directly?
  - manigandham 8y ago
    Latest software (using v10.3), better performance (nvme SSDs), better backups (point in time, instant cloning), better features (more extensions, cross-region replication even across different clouds), better flexibility (migrate master across different clouds), better monitoring (logs and datadog metrics export), and more focused support with a smaller team.
    - bpicolo 8y ago
      AWS and GCP both have nvme SSDs for instance types intended for big-ol DBs https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ssd-instance-store.html https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ssd-inst...
      - manigandham 8y ago
        Yes, I know. This thread is about managed database services, specifically about Aiven vs cloud-direct. Aiven still runs VMs on AWS or GCP but offers nvme disks while neither RDS nor CloudSQL have that available.
        bpicolo 8y ago
        Ah I see, i3 isn’t in the RDS pool yet. I imagine it will be eventually?
    - sandGorgon 8y ago
      It's way more expensive. Have you found ROI there ?
      - manigandham 8y ago
        For our needs, yes. They run on cloud VMs so there will be a markup but their startup-4 and higher plans on GCP use local NVME SSDs so we get much better performance for the price. We also make use of cross-regional replicas and are looking at doing it across clouds so if you want that then there isn't any other option other than doing it yourself. It's more of the complexity of this deployment rather than raw db size for us so if you have several TBs then maybe it's not the best fit.
- kdv 8y ago
  Interesting. I'm curious how they compare to Citus and if there are any tight integrations with their over services (managed Kafka or Elasticsearch)
- deleted 8y ago
  [deleted]
fowl2 8y ago
From the big players there's also Azure (https://azure.microsoft.com/en-us/services/postgresql/ https://azure.microsoft.com/en-us/services/postgresql/) and Amazon (https://aws.amazon.com/rds/postgresql/ https://aws.amazon.com/rds/postgresql/)
flamingcow 8y ago
[I'm the Cloud SQL TL] Note that we currently only support PostgreSQL 9.6. Obviously supporting major versions across both MySQL and PostgreSQL is a priority for us.
brdd 8y ago
We've been running a production workload on Postgres/Google Cloud SQL for about half a year now. While things are good for the most part, a couple of serious problems related to connectivity have us completely boggled. We're connecting from Google Kubernetes Engine, which seems like it should be a standard combination, but run into constant problems that we've dumped many many hours into debugging. We still haven't figured this problem out. I've found the docs to be very weak on Google's part. A lot of the troubleshooting tips are not very helpful (and can consist of unhelpful broad strokes like "be sure to use indexes!"). Because Google Cloud is not as popular than AWS, there is less community guidance from others. And what guidance does exist is often in forum threads that feel less than reputable. There's a big push to try to get you to talk to sales rep that are not technically knowledgeable and just try to upsell. Very frustrating. Unclear if moving back to AWS, or hosting our own Postgres, would help.
- dvdgsng 8y ago
  Could you elaborate a bit on the connectivity problems? What is your setup? CloudSQL Proxy, any loadbalancers?
craigkerstiens 8y ago
Hi, Craig from Citus here. If you're interested in Citus being available on other infrastructure provides aside from AWS as a fully managed service please feel free to reach out to me directly craig at citusdata.com.

by kdv 8y ago

alexnewman 8y ago

citus isn't simply postgresql. It has many tradeoffs

kdv 8y ago
We get that, but I left off (for brevity) the reasons why Citus would be a net positive for our use case.
- ivanr 8y ago
  I would appreciate if you could list some of those differences and tradeoffs, for some of us who are interested in Citus but haven't yet had time to look at it in more detail. Thanks!
manigandham 8y ago
What do you mean? It's just an extension to PostgreSQL and runs anywhere that allows you to load it.

manigandham 8y ago

We did, but now use https://aiven.io https://aiven.io Highly recommended if you want a fast and featured managed db service.

misterbowfinger 8y ago
what's the benefit of using them vs. AWS or GCP directly?
- manigandham 8y ago
  Latest software (using v10.3), better performance (nvme SSDs), better backups (point in time, instant cloning), better features (more extensions, cross-region replication even across different clouds), better flexibility (migrate master across different clouds), better monitoring (logs and datadog metrics export), and more focused support with a smaller team.
  - bpicolo 8y ago
    AWS and GCP both have nvme SSDs for instance types intended for big-ol DBs https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ssd-instance-store.html https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ssd-inst...
    - manigandham 8y ago
      Yes, I know. This thread is about managed database services, specifically about Aiven vs cloud-direct. Aiven still runs VMs on AWS or GCP but offers nvme disks while neither RDS nor CloudSQL have that available.
      - bpicolo 8y ago
        Ah I see, i3 isn’t in the RDS pool yet. I imagine it will be eventually?
  - sandGorgon 8y ago
    It's way more expensive. Have you found ROI there ?
    - manigandham 8y ago
      For our needs, yes. They run on cloud VMs so there will be a markup but their startup-4 and higher plans on GCP use local NVME SSDs so we get much better performance for the price. We also make use of cross-regional replicas and are looking at doing it across clouds so if you want that then there isn't any other option other than doing it yourself. It's more of the complexity of this deployment rather than raw db size for us so if you have several TBs then maybe it's not the best fit.
kdv 8y ago
Interesting. I'm curious how they compare to Citus and if there are any tight integrations with their over services (managed Kafka or Elasticsearch)
deleted 8y ago
[deleted]

fowl2 8y ago

From the big players there's also Azure (https://azure.microsoft.com/en-us/services/postgresql/ https://azure.microsoft.com/en-us/services/postgresql/) and Amazon (https://aws.amazon.com/rds/postgresql/ https://aws.amazon.com/rds/postgresql/)

flamingcow 8y ago

[I'm the Cloud SQL TL] Note that we currently only support PostgreSQL 9.6. Obviously supporting major versions across both MySQL and PostgreSQL is a priority for us.

brdd 8y ago

We've been running a production workload on Postgres/Google Cloud SQL for about half a year now. While things are good for the most part, a couple of serious problems related to connectivity have us completely boggled. We're connecting from Google Kubernetes Engine, which seems like it should be a standard combination, but run into constant problems that we've dumped many many hours into debugging. We still haven't figured this problem out. I've found the docs to be very weak on Google's part. A lot of the troubleshooting tips are not very helpful (and can consist of unhelpful broad strokes like "be sure to use indexes!"). Because Google Cloud is not as popular than AWS, there is less community guidance from others. And what guidance does exist is often in forum threads that feel less than reputable. There's a big push to try to get you to talk to sales rep that are not technically knowledgeable and just try to upsell. Very frustrating. Unclear if moving back to AWS, or hosting our own Postgres, would help.

dvdgsng 8y ago
Could you elaborate a bit on the connectivity problems? What is your setup? CloudSQL Proxy, any loadbalancers?

craigkerstiens 8y ago

Hi, Craig from Citus here. If you're interested in Citus being available on other infrastructure provides aside from AWS as a fully managed service please feel free to reach out to me directly craig at citusdata.com.