4 ms·
Don't get me wrong, I run SQLite in production with millions of records, but it seems people have discovered it just very recently. All of the sudden, there's a
by pachico 4y ago
Don't get me wrong, I run SQLite in production with millions of records, but it seems people have discovered it just very recently.
All of the sudden, there's always a post about it with hundreds of comments.
What changed?
- likeabbas 4y agoNoSQL is no longer cool
- EMM_386 4y agoIt seems to come in waves, there was another round of SQLite posts hitting the front page around 6 months ago as I recall. I'm not sure why, SQLite is the most widely deployed database engine on the planet, so it's not as if the technology is really "gaining" in popularity ... it's already there. I was always curious if this is due to the huge number of new developers, many front-end, who have joined IT over the past decade or so, now venturing out and beginning to learn about relational databases and their benefits.
- benbjohnson 4y agoAuthor here. I agree there's been a resurgence lately. My working theory is that the performance of the underlying hardware has increased so much in the last decade that the simplicity of SQLite has become a more important tradeoff than the extra performance boost you may see with Postgres/MySQL. Also, network overhead tends to dominate small queries so SQLite can actually end up a lot faster since it's in-process. I wrote up a longer version here: https://fly.io/blog/all-in-on-sqlite-litestream/ https://fly.io/blog/all-in-on-sqlite-litestream/
- _vvhw 4y ago“the performance of the underlying hardware has increased so much in the last decade that the simplicity of SQLite has become a more important tradeoff” Thanks for articulating this so clearly! It's going to be interesting also to see how much simplicity is realized from new thread-per-core designs leveraging io_uring to get rid of multithreading, locks and memory barriers scattered throughout the control plane. The performance dynamics are all changing and it's easier than ever to be writing simple, fast systems, that hit the 90% sweet spot. You've probably also seen McSherry et. al's “Scalability! But at what COST?” [1] [1] http://www.frankmcsherry.org/graph/scalability/cost/2015/01/15/COST.html http://www.frankmcsherry.org/graph/scalability/cost/2015/01/...
- tyingq 4y agoI suspect part of it is things like litestream, dqlite, rqlite, etc. Opens it up to people who have to make it work in some distributed fashion.
- TylerE 4y agoNotice how all these articles have the same author?
- viraptor 4y agoFlyio is bullish on sqlite. They post a lot of tech stuff about it. That helps sqlite, but also keeps Flyio in the news.
- tptacek 4y agoThat's true as far as it goes, but also Ben works here,exclusively on the open-source Litestream project, so his blog posts end up on our blog sort of naturally.
- DimmieMan 4y agoPossibly confirmation bias but 'Simple' has gotten really trendy and for databases it doesn't get much simpler. Quite a few posts appealing to the idea of "why are we doing all this nonsense? X does the job just fine".
- Scarbutt 4y agoThe new edge computing fad. These companies need a way to bring the database to the edge too, so they are heavily promoting sqlite as the best thing since slice bread to sell their services as the one solution to all your problems :)