3 ms·

Any recommendations for an embedded embedding database (heh)? Embedded, as in sqlite. For smaller-scale problems, but hopefully more convenient than say, LMDB +

Any recommendations for an embedded embedding database (heh)? Embedded, as in sqlite. For smaller-scale problems, but hopefully more convenient than say, LMDB + FAISS.

ripley12 3y ago
FWIW, Simon Willison's `llm` tool just uses SQLite plus a few UDFs. The simplicity of that approach is appealing to me but I don't have a good sense of when+why it becomes insufficient.
- dimatura 3y ago
  Thanks, I'll check it out.
pjot 3y ago
I actually just finished a POC using DuckDB that does similarity search for HN comments. https://github.com/patricktrainer/hackernews-comment-search https://github.com/patricktrainer/hackernews-comment-search
PhilippGille 3y ago
For Python I believe Chroma [1] can be used embedded. For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go https://github.com/philippgille/chromem-go It's neither advanced nor for scale yet, but the RAG demo works. [1] https://github.com/chroma-core/chroma https://github.com/chroma-core/chroma
catketch 3y ago
https://github.com/asg017/sqlite-vss https://github.com/asg017/sqlite-vss
- dimatura 3y ago
  awesome, how did I not find this :D
dmezzetti 3y ago
You can take a look at txtai (https://github.com/neuml/txtai https://github.com/neuml/txtai). It can run in a Python process. It has support for storing content in SQLite and embeddings vectors in local vector index formats (Faiss, HNSW, Annoy). Disclaimer: I'm the primary author of txtai.
ehsanu1 3y ago
I've used usearch successfully for a small project: https://github.com/unum-cloud/usearch/ https://github.com/unum-cloud/usearch/
wdroz 3y ago
The qdrant clients support a local mode where you point to a file[0]. [0] -- https://github.com/qdrant/qdrant-client#local-mode https://github.com/qdrant/qdrant-client#local-mode
andre-z 3y ago
Qdrant as a library project https://github.com/tyrchen/qdrant-lib https://github.com/tyrchen/qdrant-lib

Any recommendations for an embedded embedding database (heh)? Embedded, as in sqlite. For smaller-scale problems, but hopefully more convenient than say, LMDB + FAISS.

ripley12 3y ago

FWIW, Simon Willison's `llm` tool just uses SQLite plus a few UDFs. The simplicity of that approach is appealing to me but I don't have a good sense of when+why it becomes insufficient.

dimatura 3y ago
Thanks, I'll check it out.

pjot 3y ago

I actually just finished a POC using DuckDB that does similarity search for HN comments. https://github.com/patricktrainer/hackernews-comment-search https://github.com/patricktrainer/hackernews-comment-search

PhilippGille 3y ago

For Python I believe Chroma [1] can be used embedded. For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go https://github.com/philippgille/chromem-go It's neither advanced nor for scale yet, but the RAG demo works. [1] https://github.com/chroma-core/chroma https://github.com/chroma-core/chroma

catketch 3y ago

https://github.com/asg017/sqlite-vss https://github.com/asg017/sqlite-vss

dimatura 3y ago
awesome, how did I not find this :D

dmezzetti 3y ago

You can take a look at txtai (https://github.com/neuml/txtai https://github.com/neuml/txtai). It can run in a Python process. It has support for storing content in SQLite and embeddings vectors in local vector index formats (Faiss, HNSW, Annoy). Disclaimer: I'm the primary author of txtai.

ehsanu1 3y ago

I've used usearch successfully for a small project: https://github.com/unum-cloud/usearch/ https://github.com/unum-cloud/usearch/

wdroz 3y ago

The qdrant clients support a local mode where you point to a file[0]. [0] -- https://github.com/qdrant/qdrant-client#local-mode https://github.com/qdrant/qdrant-client#local-mode

andre-z 3y ago

Qdrant as a library project https://github.com/tyrchen/qdrant-lib https://github.com/tyrchen/qdrant-lib