4 ms·

Thanks! I tried a few other approaches and found the LLM results were overall better (latency and cost aside). Maybe that should be an option made available to

Thanks! I tried a few other approaches and found the LLM results were overall better (latency and cost aside). Maybe that should be an option made available to users though...

bardiapour 2y ago
i think not, better results >>> better latency + cost
- robrenaud 2y ago
  Maybe a combined approach beats either? Let some non-LLM reranker quickly spit out two results, and fill in the rest with the LLM.
isoprophlex 2y ago
Cohere has a very cheap, fast and effective reranking API! https://cohere.com/rerank https://cohere.com/rerank