4 ms·
I don’t understand why we have so many companies working on vector databases when the real value is in fine tuned embeddings. Having recently evaluated vector D
by serjester 2y ago
I don’t understand why we have so many companies working on vector databases when the real value is in fine tuned embeddings. Having recently evaluated vector DB’s to handle 100M+ nodes, everything will run you $1 - 8k per month. Yet using embeddings fine tuned on a specific use case, will lower that 10X since you can get away with way coarser vectors.
This makes so much intuitive sense - voyage please release an insurance focused model.
- digdugdirk 2y agoCan you explain more about this, or point someone in the right direction with a few resources for reading more about it?
- apricot0 2y agoCan you recommend any resources/tutorials about fine-tuning embedding models? Which base model did you fine-tune?
- ghxst 2y agoWhat's an insurance focused model in this context? Sorry if it's a stupid question.
- parentheses 2y agoThe answer is obvious. Vector DBs have clear line of sight. Experimental embeddings do not.