4 ms·
Recommend reranking. You basically get full resolution performance for a negligible latency hit. (Unless you need to make two network calls…) MixedBread suppor
by intalentive 2y ago
Recommend reranking. You basically get full resolution performance for a negligible latency hit. (Unless you need to make two network calls…)
MixedBread supports matryoshka embeddings too so that’s another option to explore on the latency-recall curve.
- Quizzical4230 2y ago> Recommend reranking. Will explore it thoroughly then! > MixedBread supports matryoshka embeddings too so that’s another option to explore on the latency-recall curve. Yes, exactly why I went with this model!