3 ms·
Txtai – A Strong Alternative to ChromaDB and LangChain for Vector Search and RAG
- westurner 2y agohttps://news.ycombinator.com/item?id=40115099 https://news.ycombinator.com/item?id=40115099 : > lancedb/lance is faster than pandas with dtype_backend="arrow" and has a vector index From https://github.com/lancedb/lance https://github.com/lancedb/lance : > Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, > [...] Vector Search > Comparison of different data formats in each stage of ML development cycle: Lance, Parquet & ORC, JSON & XML, TFRecord, Database, Warehouse What can ChromaDB do that lancedb can't, and will either work in WASM? From https://github.com/chroma-core/chroma https://github.com/chroma-core/chroma : > By default, Chroma uses Sentence Transformers to embed for you but you can also use OpenAI embeddings, Cohere (multilingual) embeddings, or your own.