6 ms·

Eddie from the DigitalOcean DevRel team here. Over the moon to get this in everyone's hands. Here to answer what I can.

jlangenauer 8y ago
Are the SSDs on these located in the servers that the DBs run on, or do they live on a separate SAN? I ask, as at a previous job, we used to run our Postgres DBs on raw Droplets, and we'd get awesome performance on disk bandwidth (which we really needed), so much so that if we'd have moved to AWS we'd have had to pay very significant $$$ for provisioned IOPS to get the same bandwidth. It'd be awesome if that same performance/price ratio was available with these new managed DBs.
- eddiezane 8y ago
  Managed Databases are built on top of our core compute platform which use local SSD's. You should get that same awesome performance!
nicolaslem 8y ago
What is the reason behind the limit of 22 connections for the small 1GB instance? I've noticed that PgBouncer can be configured automatically, but still standalone PG should be able to support more than that.
- eddiezane 8y ago
  Each open connection is a fork that takes up ~10MB. There is actually a 25 connection limit (3 are reserved for maintenance) so that's ~250MB just on connections. More info here [0]. 0: https://www.digitalocean.com/docs/databases/how-to/postgresql/manage-connection-pools/ https://www.digitalocean.com/docs/databases/how-to/postgresq...
jpgvm 8y ago
When configuring a number of standby nodes > 1 what replication topology is used? Are {all,none,some} replicas synchronous? Is the postgres super user available? What is the list of supported extensions? Can WAL (physical/streaming) replication be configured to a non-managed postgresql instance? I'm assuming logical replication slots should be supported. Is there in-built streaming backups/point in time restore? Any details you can share on how failover and general cluster management is performed? Are version upgrades supported? Assuming that would use pg_upgrade but is there an option for downtime-less upgrades using logical replication?
- eddiezane 8y ago
  Some of these are from our support playbook and I'm working on getting a few others. > When configuring a number of standby nodes > 1 what replication topology is used? Are {all,none,some} replicas synchronous? Trying to get an answer of this one. > Is the postgres super user available? At this time only our administrative users are superusers for the database. All other administrative tasks should be possible from the default "doadmin" user provided when setting up your database cluster. You can see a list of current users in the database (including ours) with this command from the Postgres CLI: \du If some administrative task isn't possible with the "doadmin" user just let us know and we can report that to our engineering team for review and potential future change. We can't promise anything immediately, but we can definitely look into changes long-term! > What is the list of supported extensions? address_standardizer address_standardizer_data_us btree_gin btree_gist chkpass citext cube dblink dict_int earthdistance fuzzystrmatch hstore intagg intarray isn ltree pg_buffercache pg_partman pg_stat_statements pg_trgm pgcrypto pgrouting pgrowlocks pgstattuple plcoffee plls plperl (PostgreSQL 9.5+) plv8 postgis postgis_sfcgal postgis_tiger_geocoder postgis_topology postgis_legacy (see note below) postgres_fdw repack (PostgreSQL 10+) sslinfo tablefunc timescaledb tsearch2 unaccent uuid-ossp > Can WAL (physical/streaming) replication be configured to a non-managed postgresql instance? I'm assuming logical replication slots should be supported. No, not available. > Is there in-built streaming backups/point in time restore? Only daily backups are available with our managed database service at this time. We maintain 7 days worth of backups for each database cluster. Backups can be viewed and restored from the Cloud Control Panel by clicking on your cluster and going to the "Backups" sub-tab. This will restore your entire database cluster to that point in time. While the backup frequency can not be adjusted to more often/weekly/monthly, you can take point-in-time backups by creating a "fork" of your database cluster. The fork can be placed at a specific point-in-time (reference your logs to find out when the transaction happened modifying the data you want to get back), or "now". > Any details you can share on how failover and general cluster management is performed? Nodes are monitored and failover happens automatically with minimal downtime if a node becomes unavailable. Some more info [0]. > Are version upgrades supported? Assuming that would use pg_upgrade but is there an option for downtime-less upgrades using logical replication? I _think_ all updates may require powering off but will try and confirm. 0: https://www.digitalocean.com/docs/databases/resources/high-availability/ https://www.digitalocean.com/docs/databases/resources/high-a...
deleted 8y ago
[deleted]
deleted 8y ago
[deleted]
thinkingemote 8y ago
Does this have PostGIS support?
- gregsadetsky 8y ago
  yes, see eddiezane's comment above
avolcano 8y ago
I have to say, I'm extremely disappointed by the pricing. It doesn't seem any cheaper than AWS's managed SQL offering (through Lightsail), nor cheaper than Cloud SQL. I'm trying to run a side project at a low rate, which is usually why I go to DigitalOcean - it's much cheaper, than, say, spinning up a bunch of Heroku dynos. In fact, I just moved a project from Heroku to DO to go from a $14/mo hosting bill to $5/mo on the cheapest VPS. My one problem has been Postgres - I don't want to self-manage a database. However, Cloud SQL is ~$9/mo at the cheapest, and RDS/Lightsail are both $15/mo at the cheapest. I'd really been hoping that DO would provide a lower-cost alternative. I'm really sad that the pricing structure doesn't bring managed databases down to hobby-tier. I don't even want a free offering; I'm happy to pay gig of space for $5/mo to run in perpetuity, with restrictions on backup retention or something. Right now, if I'm an actual startup or even bootstrapped company with money, I see _zero_ reason to use DO's offering over your more-established competitors, and as a hobbyist user, I can't justify spending money on it for a no-income side project.
- bpicolo 8y ago
  At the point you care about backups and standby nodes, you're already sort of outside the cheapo hobby tier. As for getting the $5/month option: Digitalocean Droplets have a 1-click Dokku install, and you can use https://github.com/dokku/dokku-postgres https://github.com/dokku/dokku-postgres to instantly pop up a postgres instance.
  - avolcano 8y ago
    That's kind of fair. I've been doing some thinking since posting this, and I've been sort of debating what a "reasonable $5/mo version" of this would be. The more I think about what managed database services usually entail, the more I concede that my original request probably isn't really a viable product (unless it was a "free tier"-style loss leader). Like, disk space and bandwidth aren't really the primary cost involved. I think what I really want is managed backups that live outside of my box, and the ability quickly restore from one if my database crashes or becomes unusable. I think automated failover to another node may not be a reasonable ask for such a cheap product. Of course, at that point: I could spin up a 1GB DigitalOcean volume for $0.10/mo, and set up scripts to run `pg_dump` every couple hours, clean the volume of older backups to free up space, and ideally a script to reset the database to a given volume. _That's all stuff I don't want to do_, but maybe someone's built a reusable set of scripts for it or something - that Dokku container is promising as a starting point, though I'm a little annoyed it only works with S3(-compatible).
gunnarmorling 8y ago
Do you have any plans for supporting logical decoding plug-ins? Would love if it was possible to enable change data capture out of Postgres on DO with Debezium (which currently supports wal2json and its own DecoderBufs logical decoding plug-in). Disclaimer: I'm the lead of Debezium.
drcongo 8y ago
I'd just like to say I'm absolutely fine with your pricing. Seems totally fair. Thanks.
exabrial 8y ago
Hey Eddie! If you guys could please take a serious look at split-horizon DNS, that'd be awesome! I can't wait for the MySQL launch, we'll be first in line
equasar 8y ago
Is there any plans to open data-centers in the South of the US? (Texas specifically), we want to consider DO but the high latency from the current ones is not an option.

Are the SSDs on these located in the servers that the DBs run on, or do they live on a separate SAN? I ask, as at a previous job, we used to run our Postgres DBs on raw Droplets, and we'd get awesome performance on disk bandwidth (which we really needed), so much so that if we'd have moved to AWS we'd have had to pay very significant $$$ for provisioned IOPS to get the same bandwidth. It'd be awesome if that same performance/price ratio was available with these new managed DBs.

eddiezane 8y ago
Managed Databases are built on top of our core compute platform which use local SSD's. You should get that same awesome performance!

nicolaslem 8y ago

What is the reason behind the limit of 22 connections for the small 1GB instance? I've noticed that PgBouncer can be configured automatically, but still standalone PG should be able to support more than that.

eddiezane 8y ago
Each open connection is a fork that takes up ~10MB. There is actually a 25 connection limit (3 are reserved for maintenance) so that's ~250MB just on connections. More info here [0]. 0: https://www.digitalocean.com/docs/databases/how-to/postgresql/manage-connection-pools/ https://www.digitalocean.com/docs/databases/how-to/postgresq...

jpgvm 8y ago

When configuring a number of standby nodes > 1 what replication topology is used? Are {all,none,some} replicas synchronous? Is the postgres super user available? What is the list of supported extensions? Can WAL (physical/streaming) replication be configured to a non-managed postgresql instance? I'm assuming logical replication slots should be supported. Is there in-built streaming backups/point in time restore? Any details you can share on how failover and general cluster management is performed? Are version upgrades supported? Assuming that would use pg_upgrade but is there an option for downtime-less upgrades using logical replication?

eddiezane 8y ago
Some of these are from our support playbook and I'm working on getting a few others. > When configuring a number of standby nodes > 1 what replication topology is used? Are {all,none,some} replicas synchronous? Trying to get an answer of this one. > Is the postgres super user available? At this time only our administrative users are superusers for the database. All other administrative tasks should be possible from the default "doadmin" user provided when setting up your database cluster. You can see a list of current users in the database (including ours) with this command from the Postgres CLI: \du If some administrative task isn't possible with the "doadmin" user just let us know and we can report that to our engineering team for review and potential future change. We can't promise anything immediately, but we can definitely look into changes long-term! > What is the list of supported extensions? address_standardizer address_standardizer_data_us btree_gin btree_gist chkpass citext cube dblink dict_int earthdistance fuzzystrmatch hstore intagg intarray isn ltree pg_buffercache pg_partman pg_stat_statements pg_trgm pgcrypto pgrouting pgrowlocks pgstattuple plcoffee plls plperl (PostgreSQL 9.5+) plv8 postgis postgis_sfcgal postgis_tiger_geocoder postgis_topology postgis_legacy (see note below) postgres_fdw repack (PostgreSQL 10+) sslinfo tablefunc timescaledb tsearch2 unaccent uuid-ossp > Can WAL (physical/streaming) replication be configured to a non-managed postgresql instance? I'm assuming logical replication slots should be supported. No, not available. > Is there in-built streaming backups/point in time restore? Only daily backups are available with our managed database service at this time. We maintain 7 days worth of backups for each database cluster. Backups can be viewed and restored from the Cloud Control Panel by clicking on your cluster and going to the "Backups" sub-tab. This will restore your entire database cluster to that point in time. While the backup frequency can not be adjusted to more often/weekly/monthly, you can take point-in-time backups by creating a "fork" of your database cluster. The fork can be placed at a specific point-in-time (reference your logs to find out when the transaction happened modifying the data you want to get back), or "now". > Any details you can share on how failover and general cluster management is performed? Nodes are monitored and failover happens automatically with minimal downtime if a node becomes unavailable. Some more info [0]. > Are version upgrades supported? Assuming that would use pg_upgrade but is there an option for downtime-less upgrades using logical replication? I _think_ all updates may require powering off but will try and confirm. 0: https://www.digitalocean.com/docs/databases/resources/high-availability/ https://www.digitalocean.com/docs/databases/resources/high-a...

deleted 8y ago

[deleted]

deleted 8y ago

[deleted]

thinkingemote 8y ago

Does this have PostGIS support?

gregsadetsky 8y ago
yes, see eddiezane's comment above

avolcano 8y ago

I have to say, I'm extremely disappointed by the pricing. It doesn't seem any cheaper than AWS's managed SQL offering (through Lightsail), nor cheaper than Cloud SQL. I'm trying to run a side project at a low rate, which is usually why I go to DigitalOcean - it's much cheaper, than, say, spinning up a bunch of Heroku dynos. In fact, I just moved a project from Heroku to DO to go from a $14/mo hosting bill to $5/mo on the cheapest VPS. My one problem has been Postgres - I don't want to self-manage a database. However, Cloud SQL is ~$9/mo at the cheapest, and RDS/Lightsail are both $15/mo at the cheapest. I'd really been hoping that DO would provide a lower-cost alternative. I'm really sad that the pricing structure doesn't bring managed databases down to hobby-tier. I don't even want a free offering; I'm happy to pay gig of space for $5/mo to run in perpetuity, with restrictions on backup retention or something. Right now, if I'm an actual startup or even bootstrapped company with money, I see _zero_ reason to use DO's offering over your more-established competitors, and as a hobbyist user, I can't justify spending money on it for a no-income side project.

bpicolo 8y ago
At the point you care about backups and standby nodes, you're already sort of outside the cheapo hobby tier. As for getting the $5/month option: Digitalocean Droplets have a 1-click Dokku install, and you can use https://github.com/dokku/dokku-postgres https://github.com/dokku/dokku-postgres to instantly pop up a postgres instance.
- avolcano 8y ago
  That's kind of fair. I've been doing some thinking since posting this, and I've been sort of debating what a "reasonable $5/mo version" of this would be. The more I think about what managed database services usually entail, the more I concede that my original request probably isn't really a viable product (unless it was a "free tier"-style loss leader). Like, disk space and bandwidth aren't really the primary cost involved. I think what I really want is managed backups that live outside of my box, and the ability quickly restore from one if my database crashes or becomes unusable. I think automated failover to another node may not be a reasonable ask for such a cheap product. Of course, at that point: I could spin up a 1GB DigitalOcean volume for $0.10/mo, and set up scripts to run `pg_dump` every couple hours, clean the volume of older backups to free up space, and ideally a script to reset the database to a given volume. _That's all stuff I don't want to do_, but maybe someone's built a reusable set of scripts for it or something - that Dokku container is promising as a starting point, though I'm a little annoyed it only works with S3(-compatible).

gunnarmorling 8y ago

Do you have any plans for supporting logical decoding plug-ins? Would love if it was possible to enable change data capture out of Postgres on DO with Debezium (which currently supports wal2json and its own DecoderBufs logical decoding plug-in). Disclaimer: I'm the lead of Debezium.

drcongo 8y ago

I'd just like to say I'm absolutely fine with your pricing. Seems totally fair. Thanks.

exabrial 8y ago

Hey Eddie! If you guys could please take a serious look at split-horizon DNS, that'd be awesome! I can't wait for the MySQL launch, we'll be first in line

equasar 8y ago

Is there any plans to open data-centers in the South of the US? (Texas specifically), we want to consider DO but the high latency from the current ones is not an option.