2 ms·
That's my point, maybe VectorDBs in production should have a fallback mechanism, for the documents inserted, 1. Generate embeddings using services such as Open
by enoch2090 3y ago
That's my point, maybe VectorDBs in production should have a fallback mechanism, for the documents inserted,
1. Generate embeddings using services such as OpenAI, which is usually more powerful;
2. Generate backup embeddings using local, more stable models, such as Llama2 embeddings or simply some BERT-family-model (which is more affordable).
When outages comes up you simply switch from one vector space to another. Though
possible, model alignments are much harder and more expensive to achieve.