4 ms·
> What if I have a billion or more embeddings? Can Postgres + pg_vector support a billion records with 1000’s or 10000’s concurrent users? Even if pg_vector is
by asah 3y ago
> What if I have a billion or more embeddings? Can Postgres + pg_vector support a billion records with 1000’s or 10000’s concurrent users? Even if pg_vector is an easy add-on to Postgres, it might not be suitable for real-time similarity searching. You should use a database that is built for scale.
Has anyone tried pg_vector on an AWS Aurora cluster or Azure Citus cluster?
- whakim 3y agoAt the scale of hundreds of millions of embeddings (the most I have experience with) pgvector has some sharp edges. Vacuuming is a huge one; it’s difficult to vacuum indices that are hundreds of GBs in size. And reasoning about recall is therefore challenging. Pgvector’s HNSW implementation also lacks support for certain features (e.g. filtering), which is fine when silently falling back to brute force is acceptable but otherwise not so much. To be clear I think pgvector is an awesome project but it certainly has limitations.