5 ms·

I’ve used SQLite for some small projects and it was a very pleasant experience. Does anyone have examples of the complex/ big projects that use SQLite ? I’m cu

I’ve used SQLite for some small projects and it was a very pleasant experience. Does anyone have examples of the complex/ big projects that use SQLite ? I’m curious what problems they ran into, and how they were addressed.

swasheck 3y ago
expensify used sqlite iirc
- w10-1 3y ago
  https://github.com/Expensify/Bedrock https://github.com/Expensify/Bedrock
  - swasheck 3y ago
    yep! thanks "Bedrock was built by Expensify, and is a networking and distributed transaction layer built atop SQLite, the fastest, most reliable, and most widely distributed database in the world." (https://bedrockdb.com/ https://bedrockdb.com/)
kristopolous 3y ago
I used to run a company with hundreds of in field machines that used sqlite for error reporting and various metrics. There were phone home scenarios of the databases transferring over to some server which then would get dumped in a directory. There were other systems that would use these hundreds of databases a few gigabytes each and create models from them for early failure detection and other things. I wish I could say this was difficult or didn't work but pretty basic scripting and sqlite on commodity hardware doing normal cpu computation got us there beyond our expectations using cheap digital ocean VPS servers with modest memory. I can be a pretty obnoxious brat when open source things are broken and nobody is taking them seriously. Here though, people took it seriously and it wasn't broken. I'm continually impressed by it. This was pre-pandemic for a timeline.
nine_k 3y ago
Firefox uses SQLite for history and other things. One of the problems is that the history may grow excessively large, which SQLite handles well but the History UI does not :)
austinjp 3y ago
It might be worth checking some of the fly.io work: https://fly.io/blog/all-in-on-sqlite-litestream/ https://fly.io/blog/all-in-on-sqlite-litestream/
klausa 3y ago
There are probably hundreds, if not thousands of SQLite databases running on every Apple device out there. One twitter-famous Core Data/SQLite engineer's bio on Twitter used to read "Over one trillion databases served", or something to that effect.
- kristopolous 3y ago
  Android has them everywhere was well https://developer.android.com/training/data-storage/sqlite https://developer.android.com/training/data-storage/sqlite
  - klausa 3y ago
    I was talking about the OS (and the built-in apps, I guess) itself — depending on how many apps you have installed I'm sure you can get that number much higher ;)
metaltyphoon 3y ago
SQLite DO-178B certified and probably used in most avionics.

swasheck 3y ago

expensify used sqlite iirc

w10-1 3y ago
https://github.com/Expensify/Bedrock https://github.com/Expensify/Bedrock
- swasheck 3y ago
  yep! thanks "Bedrock was built by Expensify, and is a networking and distributed transaction layer built atop SQLite, the fastest, most reliable, and most widely distributed database in the world." (https://bedrockdb.com/ https://bedrockdb.com/)

kristopolous 3y ago

I used to run a company with hundreds of in field machines that used sqlite for error reporting and various metrics. There were phone home scenarios of the databases transferring over to some server which then would get dumped in a directory. There were other systems that would use these hundreds of databases a few gigabytes each and create models from them for early failure detection and other things. I wish I could say this was difficult or didn't work but pretty basic scripting and sqlite on commodity hardware doing normal cpu computation got us there beyond our expectations using cheap digital ocean VPS servers with modest memory. I can be a pretty obnoxious brat when open source things are broken and nobody is taking them seriously. Here though, people took it seriously and it wasn't broken. I'm continually impressed by it. This was pre-pandemic for a timeline.

nine_k 3y ago

Firefox uses SQLite for history and other things. One of the problems is that the history may grow excessively large, which SQLite handles well but the History UI does not :)

austinjp 3y ago

It might be worth checking some of the fly.io work: https://fly.io/blog/all-in-on-sqlite-litestream/ https://fly.io/blog/all-in-on-sqlite-litestream/

klausa 3y ago

There are probably hundreds, if not thousands of SQLite databases running on every Apple device out there. One twitter-famous Core Data/SQLite engineer's bio on Twitter used to read "Over one trillion databases served", or something to that effect.

kristopolous 3y ago
Android has them everywhere was well https://developer.android.com/training/data-storage/sqlite https://developer.android.com/training/data-storage/sqlite
- klausa 3y ago
  I was talking about the OS (and the built-in apps, I guess) itself — depending on how many apps you have installed I'm sure you can get that number much higher ;)

metaltyphoon 3y ago

SQLite DO-178B certified and probably used in most avionics.