3 ms·
Would have loved to use sqlite if I could get good results. Maybe I botched the implementation.
by correa_brian 1y ago
Would have loved to use sqlite if I could get good results. Maybe I botched the implementation.
- alexgarcia-xyz 1y agoCreator of sqlite-vec here, happy to help debug anything if you do attempt to try out SQLite vector search again. You mentioned "VSS" in another comment, which if that was my sqlite-vss extension, I more-or-less abandoned that extension for sqlite-vec last year. The VSS extension was more unstable and bloated (based on Faiss), but the new VEC extension is much more lightweight and easy to use (custom C vector functions). The new metadata column support is also pretty nice, and can be used for push-down filtering. That being said, sqlite-vec still doesn't have ANN yet (but can brute-force ~10k's-100k of vectors quick enough), and I've fallen behind on updates and new releases. Hoping to push out a desperately-needed update this week link: https://alexgarcia.xyz/sqlite-vec/ https://alexgarcia.xyz/sqlite-vec/ And there are a few other SQLite-based vector search extensions/tools out there, so the ecosystem is general might be worth another look.
- correa_brian 1y agoHey Alex - thanks for commenting. I'd be interested in giving this all another look. Like we mentioned in the post + comments, We went with redis because that's what got us the results we wanted. I'm open to revisiting our vector storage if it spares us needing to manage a separate db process.
- correa_brian 1y agoEnded up swapping out redis for sqlite-vec. Works great. Thanks