3 ms·
The search speed is amazing!! Do you have to do a lot of pre-indexing to get it so fast?
by sdwr 4y ago
The search speed is amazing!! Do you have to do a lot of pre-indexing to get it so fast?
- simonw 4y agoIt's SQLite's built in FTS index, nothing special on top of it. I built the index by running: sqlite-utils enable-fts data.db images text https://sqlite-utils.datasette.io/en/stable/cli.html#configuring-full-text-search https://sqlite-utils.datasette.io/en/stable/cli.html#configu...
- sdwr 4y agoAre you running on anything special compute-wise? I have a budget node running Mongo, it takes almost a second to fetch a single 1MB document. Writing it out I realize it's not indexed by the attribute I'm retrieving by...
- isoprophlex 4y agoUse the index, Luke!
- snovv_crash 4y agoBut MongoDB is webscale!
- simonw 4y agoI started this on a Fly instance with 256MB of RAM and a shared CPU. This worked great when it was just a couple of people testing it. Once it started getting traffic it started running a bit slow, so I bumped it up to a 2 CPU instance with 4GB of RAM and it's been fine since then. The database file is nearly 4GB and almost all memory is being used, so I guess it all got loaded into RAM by SQLite. I'll scale it back down again in a few days time, once interest in it wanes a bit.