3 ms·
i think not, better results >>> better latency + cost
by bardiapour 2y ago
i think not, better results >>> better latency + cost
- robrenaud 2y agoMaybe a combined approach beats either? Let some non-LLM reranker quickly spit out two results, and fill in the rest with the LLM.