4 ms·
Came here to post this. So curious about the choice to NOT use sqlite.
by turnsout 1y ago
Came here to post this. So curious about the choice to NOT use sqlite.
- correa_brian 1y agoWould have loved to use sqlite if I could get good results. Maybe I botched the implementation.
- alexgarcia-xyz 1y agoCreator of sqlite-vec here, happy to help debug anything if you do attempt to try out SQLite vector search again. You mentioned "VSS" in another comment, which if that was my sqlite-vss extension, I more-or-less abandoned that extension for sqlite-vec last year. The VSS extension was more unstable and bloated (based on Faiss), but the new VEC extension is much more lightweight and easy to use (custom C vector functions). The new metadata column support is also pretty nice, and can be used for push-down filtering. That being said, sqlite-vec still doesn't have ANN yet (but can brute-force ~10k's-100k of vectors quick enough), and I've fallen behind on updates and new releases. Hoping to push out a desperately-needed update this week link: https://alexgarcia.xyz/sqlite-vec/ https://alexgarcia.xyz/sqlite-vec/ And there are a few other SQLite-based vector search extensions/tools out there, so the ecosystem is general might be worth another look.
- correa_brian 1y agoHey Alex - thanks for commenting. I'd be interested in giving this all another look. Like we mentioned in the post + comments, We went with redis because that's what got us the results we wanted. I'm open to revisiting our vector storage if it spares us needing to manage a separate db process.
- correa_brian 1y agoEnded up swapping out redis for sqlite-vec. Works great. Thanks