5 ms·

- That's not what they said. - You think people replace a MongoDB cluster by a single Posgres instance? You guys should really use HA, cluster in real life and

by Thaxll 9y ago

- That's not what they said. - You think people replace a MongoDB cluster by a single Posgres instance? You guys should really use HA, cluster in real life and stop reading reddit / HN and the hype behind PG, with 3.5M+ CCU no one would use an architecture with a single master / slave ( that's what pg is ). MongoDB / MySQL have bad press by people that never used it in real life and just repeat what they read online. I could tell you horror story about pg not have an official replication system until 2011 when pg 9.0 landed.

woolvalley 9y ago
You can cluster with postgres & mysql, but you have to implement the clustering / sharding logic yourself. Nowadays I would just use redis & cassandra if you need something beyond a collection of postgres instances. Most projects do not.
- dankohn1 9y ago
  For clustering MySQL, take a look at Vitess. It was developed at YouTube and recently adopted into CNCF: https://www.cncf.io/blog/2018/02/05/cncf-host-vitess/ https://www.cncf.io/blog/2018/02/05/cncf-host-vitess/ (Disclosure: I'm executive director of CNCF.)
stevenwoo 9y ago
I feel I need to quote the post mortem back at you so you point out where I mis read the quote. "Our top focus right now is to ensure service availability. Our next steps are below: Identify and resolve the root cause of our DB performance issues. We’ve flown Mongo experts on-site to analyze our DB and usage, as well as provide real-time support during heavy load on weekends." How does that disagree with my post?
- Thaxll 9y ago
  You're implying they couldn't fix MongoDB or reached the limit which is false. In the current ( HN ) post they said they fixed it, I'm pretty sure they didn't have any experience in DBs in the first place hence why they asked for help. Nowhere in the original post they mention issues related to MongoDB itself it was probably bad design on their side.
  - stevenwoo 9y ago
    OK I should have been clearer about my interpretation - I read flying in experts as they flew in experts from MongoDB and stumped them so that had me thinking maybe this is not possible if they stumped them. Earlier in this thread one of the engineers from MongoDB says Epic solved the issue but had not updated the blog so I was wrong about that.
dijit 9y ago
> I could tell you horror story about pg not have an official replication system until 2011 when pg 9.0 landed. And I would re-iterate that just because something isn't in mainline, doesn't mean it's not possible. Did you know that Pg didn't have native partitioning until Pg10? Somehow we managed to do partitioning before then. I don't buy the argument that you need to ship broken features just to have them; Pg doesn't include it into base until it's a /good/ solution which is well engineered and has appropriate toggles. That is not a horror story. > - You think people replace a MongoDB cluster by a single Posgres instance? You guys should really use HA, cluster in real life and stop reading reddit / HN and the hype behind PG, with 3.5M+ CCU no one would use an architecture with a single master / slave ( that's what pg is ). I shipped a game which had similar CCUs (within the order of magnitude) and I can confirm that you can't do it with one postgresql machine, or.. actually you could but we chose to fsync() constantly to prevent corruption from ever happening and remove the RAID cache.. but you can shard on top of your database solution too.
takeda 9y ago
> I could tell you horror story about pg not have an official replication system until 2011 when pg 9.0 landed. I could tell you a horror story that happened to me just few weeks ago, where MariaDB just corrupted data out of nowhere due to a bug[1]. This happened multiple times and costed us multiple hours of work (including service being down) each time it happened until we realized the issue wasn't hardware but a software bug. If you ask me, I take PostgreSQL approach of not having a broken replication before 2011 than MySQLs still corrupting data. Data usually is the most valuable asset a company has. [1] https://jira.mariadb.org/browse/MDEV-10977 https://jira.mariadb.org/browse/MDEV-10977

by Thaxll 9y ago

woolvalley 9y ago

You can cluster with postgres & mysql, but you have to implement the clustering / sharding logic yourself. Nowadays I would just use redis & cassandra if you need something beyond a collection of postgres instances. Most projects do not.

dankohn1 9y ago
For clustering MySQL, take a look at Vitess. It was developed at YouTube and recently adopted into CNCF: https://www.cncf.io/blog/2018/02/05/cncf-host-vitess/ https://www.cncf.io/blog/2018/02/05/cncf-host-vitess/ (Disclosure: I'm executive director of CNCF.)

stevenwoo 9y ago

I feel I need to quote the post mortem back at you so you point out where I mis read the quote. "Our top focus right now is to ensure service availability. Our next steps are below: Identify and resolve the root cause of our DB performance issues. We’ve flown Mongo experts on-site to analyze our DB and usage, as well as provide real-time support during heavy load on weekends." How does that disagree with my post?

Thaxll 9y ago
You're implying they couldn't fix MongoDB or reached the limit which is false. In the current ( HN ) post they said they fixed it, I'm pretty sure they didn't have any experience in DBs in the first place hence why they asked for help. Nowhere in the original post they mention issues related to MongoDB itself it was probably bad design on their side.
- stevenwoo 9y ago
  OK I should have been clearer about my interpretation - I read flying in experts as they flew in experts from MongoDB and stumped them so that had me thinking maybe this is not possible if they stumped them. Earlier in this thread one of the engineers from MongoDB says Epic solved the issue but had not updated the blog so I was wrong about that.

dijit 9y ago

> I could tell you horror story about pg not have an official replication system until 2011 when pg 9.0 landed. And I would re-iterate that just because something isn't in mainline, doesn't mean it's not possible. Did you know that Pg didn't have native partitioning until Pg10? Somehow we managed to do partitioning before then. I don't buy the argument that you need to ship broken features just to have them; Pg doesn't include it into base until it's a /good/ solution which is well engineered and has appropriate toggles. That is not a horror story. > - You think people replace a MongoDB cluster by a single Posgres instance? You guys should really use HA, cluster in real life and stop reading reddit / HN and the hype behind PG, with 3.5M+ CCU no one would use an architecture with a single master / slave ( that's what pg is ). I shipped a game which had similar CCUs (within the order of magnitude) and I can confirm that you can't do it with one postgresql machine, or.. actually you could but we chose to fsync() constantly to prevent corruption from ever happening and remove the RAID cache.. but you can shard on top of your database solution too.

takeda 9y ago

> I could tell you horror story about pg not have an official replication system until 2011 when pg 9.0 landed. I could tell you a horror story that happened to me just few weeks ago, where MariaDB just corrupted data out of nowhere due to a bug[1]. This happened multiple times and costed us multiple hours of work (including service being down) each time it happened until we realized the issue wasn't hardware but a software bug. If you ask me, I take PostgreSQL approach of not having a broken replication before 2011 than MySQLs still corrupting data. Data usually is the most valuable asset a company has. [1] https://jira.mariadb.org/browse/MDEV-10977 https://jira.mariadb.org/browse/MDEV-10977