4 ms·
As somebody who does DevOps consulting I was baffled how they could be down all day if it was a pure operations issue. That tweet is just speculation though. Ho
by nodesocket 7y ago
As somebody who does DevOps consulting I was baffled how they could be down all day if it was a pure operations issue. That tweet is just speculation though. Hopefully more facts and details come out.
My bet is still on it being a database issue. If they indeed are using AWS RDS, I wouldn’t be surprised if they have half of AWS support engineers working on it. Once again, if I had to bet, I say they rolled their own "half-baked" database solution instead of using a AWS native offering.
- yushuf 7y agoI recently interviewed there and they said they're still using Postgres master-slave setup most likely on some cloud provider. Could be catastrophic failure with multiple shards going down at the same time. This might also explain why they mentioned their "backups" not working
- nodesocket 7y agoI believe they are on AWS, so maybe RDS PostgreSQL. If so they should be getting unlimited support from top tier AWS engineers.
- opsunit 7y agoIf that is true and they're not on the ball they have another hard deadline fast approaching: https://aws.amazon.com/blogs/database/amazon-rds-customers-update-your-ssl-tls-certificates-by-february-5-2020/ https://aws.amazon.com/blogs/database/amazon-rds-customers-u... (yes: the URI says February 5th whilst the article says March 5th!)
- aeyes 7y agoWhy would they get unlimited support from "top tier" AWS engineers? A company like Robinhood doesn't strike me as a strong candidate for contracting AWS Enterprise support. For the price you get almost nothing out of it.
- vasco 7y agoUsually Enterprise comes with other benefits that, for large enough bills, offsets the extra cost support cost.