3 ms·

Note that they were running psql on ec2 instances, which implies bare metal with SSDs. Yes you can get actual hosts in AWS if you pay for them. The article al

by mannyv 9mo ago

Note that they were running psql on ec2 instances, which implies bare metal with SSDs. Yes you can get actual hosts in AWS if you pay for them. The article also implies that they were never able to get psql to replicate effectively. Whomever their DBA was was couldn't do it, so they were like "fuck it, let's move to Aurora." Their database brought no actual value, so it make sense for them.

yearolinuxdsktp 9mo ago
They likely were running data on EBS volumes instead of bare metal SSDs, due to ease of recovery (a failed instance does not lose data on the attached EBS volumes). You can only run your DBs on bare metal SSDs if you are prepared to lose a node’s data completely. In fact, many instance types no longer have any ephemeral storage attached and it’s a default practice to use EBS for root and data volumes. There are some instance types that have extremely fast EBS performance (EBS io2 Block Express), which has hardware acceleration and an optimized network protocol for EBS network I/O and offers sub-millisecond latency. However, these are expensive and get even more so if you go up in IOPS.
- Tostino 9mo ago
  I'd argue you need the infrastructure to recover from loss of a host regardless if you have backups setup properly. Using EBS seems like a total anti-pattern for DB workloads.
ericmcer 9mo ago
I wonder if he still has a job? Running all your postgres on ec2 is like 1000X harder than looking at the dashboard for an Aurora cluster.
LunaSea 9mo ago
> Note that they were running psql on ec2 instances, which implies bare metal with SSDs. No, this doesn't imply SSDs. EC2 instances do not have access to SSDs but to EBS volumes which is a much slower distributed network block storage medium. Not sure about their PostgreSQL replication issues but lots of companies manage to make it work without a hitch.
- ActorNightly 9mo ago
  You can have EC2s with ssds. But generally the workflow for running your own DB is smart caching in memory on top of whatever storage you got.
  - LunaSea 9mo ago
    The problem with the metal instances you are referring to is that the SSD is lost if you stop and start the server.

by mannyv 9mo ago

yearolinuxdsktp 9mo ago

They likely were running data on EBS volumes instead of bare metal SSDs, due to ease of recovery (a failed instance does not lose data on the attached EBS volumes). You can only run your DBs on bare metal SSDs if you are prepared to lose a node’s data completely. In fact, many instance types no longer have any ephemeral storage attached and it’s a default practice to use EBS for root and data volumes. There are some instance types that have extremely fast EBS performance (EBS io2 Block Express), which has hardware acceleration and an optimized network protocol for EBS network I/O and offers sub-millisecond latency. However, these are expensive and get even more so if you go up in IOPS.

Tostino 9mo ago
I'd argue you need the infrastructure to recover from loss of a host regardless if you have backups setup properly. Using EBS seems like a total anti-pattern for DB workloads.

ericmcer 9mo ago

I wonder if he still has a job? Running all your postgres on ec2 is like 1000X harder than looking at the dashboard for an Aurora cluster.

LunaSea 9mo ago

> Note that they were running psql on ec2 instances, which implies bare metal with SSDs. No, this doesn't imply SSDs. EC2 instances do not have access to SSDs but to EBS volumes which is a much slower distributed network block storage medium. Not sure about their PostgreSQL replication issues but lots of companies manage to make it work without a hitch.

ActorNightly 9mo ago
You can have EC2s with ssds. But generally the workflow for running your own DB is smart caching in memory on top of whatever storage you got.
- LunaSea 9mo ago
  The problem with the metal instances you are referring to is that the SSD is lost if you stop and start the server.