4 ms·
Implementations that use vector database do not use LLMs to generate queries against those databases. That would be incredibly expensive and slow (and yes ther
by mr_toad 1y ago
Implementations that use vector database do not use LLMs to generate queries against those databases. That would be incredibly expensive and slow (and yes there is a certain irony there).
Main advantages of a vector lookup are built-in fuzzy matching and the potential to keep a large amount of documentation in memory for low latency. I can’t see an RDMS being ideal for either. LLMs are slow enough already, adding a slow document lookup isn’t going to help.
- 9rx 1y agoThe main disadvantage of vector lookup, allegedly, is that it doesn't work as well in practice. Did you, uh, forget to read the thread?
- cluckindan 1y agoWhat does ”doesn’t work as well” mean here? From my experience, vector lookup via HNSW is fast and accurate enough for practical purposes.
- 9rx 1y ago[flagged]