4 ms·
> Still, you didn't define it. What's the data schema? What is the application? I don't know what to say, if your app is a TODO list app that's wildly popular,
by endisneigh 4y ago
> Still, you didn't define it. What's the data schema? What is the application? I don't know what to say, if your app is a TODO list app that's wildly popular, then I guarantee I can do what you want with SQLite easily. If it's Spotify-level stuff with special aggregation and data analysis, maybe not?
sigh. any app based on SQLite with more than 1 million concurrent users, 75% reads.
- ok_dad 4y agoHere's one specific one, I would imagine they have a pretty big user base: https://tailscale.com/blog/database-for-2022/ https://tailscale.com/blog/database-for-2022/ Here are a few other sources I googled: https://www.sqlite.org/famous.html https://www.sqlite.org/famous.html https://stackshare.io/sqlite https://stackshare.io/sqlite This is the best I can do, because I have no idea what else you want. If I had the time, I could throw up a simulated million users doing a TODO app with SQLite as the backing DB engine, but I don't have time, I have a 2 year old. Do your own research from here, or don't and just use Postgres until you retire, I don't really care that much.
- Scarbutt 4y agosigh. any app based on SQLite with more than 1 million concurrent users, 75% reads. Definitely not the use case for SQLite unless you can easily do sharding but as you said, why bother?
- tptacek 4y agoA million concurrent, with a database-backed website? Is that a useful threshold? How many monthly actives is a million concurrent? And, at that scale, is your database your gating factor, or is app architecture?
- kasey_junk 4y agoCan you name a single application that has 250k concurrent writes (per second I assume as you didn’t stipulate) using a consistent sql backend (that is no external caching/sharing layer)? I don’t think your example is a good fit for SQLite as it’s not a good fit for any sql store that I know of.
- endisneigh 4y agoA few vendors doing time series data. Even if you lowered it a couple orders of magnitude. I haven’t seen any app doing even 5K concurrent writes backed by SQLite.
- kasey_junk 4y agoWhat time series vendor is offering high write throughput consistent sql? Legitimately interested as this is something I have more than a little professional interest. That said, “show me an app doing 5k concurrent writes with SQLite” seems like a much more reasonable standard.
- rrdharan 4y agoUber, on Google Cloud Spanner, seems to be in this ballpark though they aren’t quite explicit about it: https://www.uber.com/blog/building-ubers-fulfillment-platform/ https://www.uber.com/blog/building-ubers-fulfillment-platfor...
- kasey_junk 4y agoSpanner is explicitly sharded. Sort of famously so.
- rrdharan 4y agoAll scale out databases use some form of sharding, tautologically. The parent asked about use cases where there wasn’t an _external_ (which I interpret to mean “handled explicitly by the app, not the database”) sharding / caching layer. Spanner internally handles splits based on load / size. That having been said, more careful reading of the Uber post shows that they still do employ additional app-level explicit sharding to resolve hot-spots, so it’s probably a fair point that this doesn’t qualify as an example the parent was looking for.
- lenkite 4y agoDon't even bother with a million. Even 1k concurrent users with 75% read/25% write is not something plain SQLite can handle without significant latency compared to Postgres.