3 ms·
This is such a familiar story. Company starts with a centralized database, runs into scaling problems, then spends man-years sharding it. Just use a distributed
by esafak 3y ago
This is such a familiar story. Company starts with a centralized database, runs into scaling problems, then spends man-years sharding it. Just use a distributed database.
- deleted 3y ago[deleted]
- Closi 3y agoThis assumes that using a distributed database from the start doesn't offer it's own penalties/drawbacks (particularly in 2016). Particularly considering as per the figma note, they consider their data highly relational (i.e. presumably this means lots of joins in queries) What database would you have chosen?
- esafak 3y agoThat's a fair response for then, but not today where you're spoiled for choice. Spanner was released as a service in 2017, which isn't far off.
- deleted 3y ago[deleted]
- jack_riminton 3y agoIf every startup used every scale-proof method available from the beginning they'd never have the time or resources to build the products to get the customers that would require them to use the scale-proof methods
- esafak 3y agoI agree with your general point but there are relational distributed databases, open source and "serverless", that are compatible with MySQL (planetscale, tidb, vitess...) and postgres (citus, cockroachdb...) edited for examples.
- noja 3y agoOne reason they don't is unhelpful comments like these: alluding to products without naming them.
- deleted 3y ago[deleted]
- ofrzeta 3y agoFrom the article: "During our evaluation, we explored CockroachDB, TiDB, Spanner, and Vitess". Three of them are open source if I am not mistaken.
- mplanchard 3y agoAnd many of these are substantially more expensive than RDS, or have terrible INSERT performance, or require making the correct decisions really early about what to use as partition keys. There's no free lunch, sadly.
- Closi 3y agoI don't think these were mature products when Figma started to be developed in 2012.
- mamcx 3y agoThere are many kinds of apps that use of "distributed" databases is an antipattern...and useless to make them scale. MOST apps did not need more than "tenant-per-company" and then, maybe, distributed among a small set of servers. Is it just that the kind of app that shows here (and has this problems) are just niche apps like social networks and complex chat apps.
- dang 3y ago"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something." https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- battwell 3y agoDoesn't seem a crazy way to start a company. RDS will have scaling problems but is very mature and fairly easy to use early on when you're working on your MVP I've used CRDB early on at a startup. There was some overhead. You don't get all the nice PSQL features Although it did save us a giant migration later on