4 ms·
pgvectorscale from the timescaledb team introduces StreamingDiskANN indexes and compression to pgvector: https://github.com/timescale/pgvectorscale https://git
by nikcub 2y ago
pgvectorscale from the timescaledb team introduces StreamingDiskANN indexes and compression to pgvector:
https://github.com/timescale/pgvectorscale https://github.com/timescale/pgvectorscale
the sales blurb:
> On a benchmark dataset of 50 million Cohere embeddings with 768 dimensions each, PostgreSQL with pgvector and pgvectorscale achieves 28x lower p95 latency and 16x higher query throughput compared to Pinecone's storage optimized (s1) index for approximate nearest neighbor queries at 99% recall, all at 75% less cost when self-hosted on AWS EC2.
been using it in dev (~2.5M embeddings to date) and so far, pretty great
edit: HN announcement + thread from a couple of months ago:
https://news.ycombinator.com/item?id=40646276 https://news.ycombinator.com/item?id=40646276