4 ms·

The majority of the corruption issues with MySQL comes from using the innodb engine. AWS built their own MySQL engine called Aurora that I would be shocked if N

by tedivm 10y ago

The majority of the corruption issues with MySQL comes from using the innodb engine. AWS built their own MySQL engine called Aurora that I would be shocked if Netflix wasn't using. It's designed for distributed workloads and should be harder to corrupt. I'll admit I'm confused about picking Cassandra as well, but not for the same reasons you are. They're only storing subscriber data (billing address, subscription type, etc). That data is going to remain static for months at a time. When changed the only potential problem that could occur is the billing process using old data, but I'm guessing their system is smart enough to try again in thirty minutes. Oracle may be fast, but it's also expensive. This is billing, which means batched jobs running in the background- they don't care how long each individual transaction takes, and I'm positive it's going to be cheaper to roll up more servers to compensate than it is to pay Oracle's licensing fees.

ec109695 10y ago
Amazon doesn't offer instances large enough on RDS, so they are managing their own. Do you have any sources for the corruption comparison between Aurora vs InnoDB?
Annatar 10y ago
> Oracle may be fast, but it's also expensive. So? That's capitalism: one gets what one pays for, and Oracle is not just fast, it can do a lot, and it can be configured to be paranoid about protecting data, and it has clustering technology meant for scaling, RAC. Truth be told they could have picked PostreSQL and it would have still been a better solution than Cassandra and MySQL.
tokensimian 10y ago
I'm not sure if you saw this other thread, but I thought it answered one of your questions so was worth sharing. Sounds like Aurora wasn't stable when this migration began, so they did the migration with an eye towards the next migration (to Aurora). Sorry about the c/p but I don't see a permalink on lapitopi's comment. lapitopi 1 day ago I work on the Netflix Billing Team. PostgreSQL was indeed a very attractive option, but we wanted to keep a path to Aurora open. When we were working on the migration, Aurora was still in beta, so instead of going to Aurora directly, we decided run our own MySQL instances on EC2. edit: begun/began

by tedivm 10y ago

ec109695 10y ago

Amazon doesn't offer instances large enough on RDS, so they are managing their own. Do you have any sources for the corruption comparison between Aurora vs InnoDB?

Annatar 10y ago

> Oracle may be fast, but it's also expensive. So? That's capitalism: one gets what one pays for, and Oracle is not just fast, it can do a lot, and it can be configured to be paranoid about protecting data, and it has clustering technology meant for scaling, RAC. Truth be told they could have picked PostreSQL and it would have still been a better solution than Cassandra and MySQL.

tokensimian 10y ago

I'm not sure if you saw this other thread, but I thought it answered one of your questions so was worth sharing. Sounds like Aurora wasn't stable when this migration began, so they did the migration with an eye towards the next migration (to Aurora). Sorry about the c/p but I don't see a permalink on lapitopi's comment. lapitopi 1 day ago I work on the Netflix Billing Team. PostgreSQL was indeed a very attractive option, but we wanted to keep a path to Aurora open. When we were working on the migration, Aurora was still in beta, so instead of going to Aurora directly, we decided run our own MySQL instances on EC2. edit: begun/began