3 ms·
This looks very cool. I'm interested in how many vectors are indexed/how large the index is that corresponds to the latency chart? If we have an in-memory HNSW
by random_moonwalk 3y ago
This looks very cool.
I'm interested in how many vectors are indexed/how large the index is that corresponds to the latency chart? If we have an in-memory HNSW index of 10M vectors at ~20GB (512 dim), say, what are the RAM requirements when using the disk-based version?
- raoufchebri 3y agoWe used 1M vectors of 1536 dimensions (OpenAI). The index size was ~6GB.
- random_moonwalk 3y agoThanks - how much RAM is required to serve from the index in that case?