3 ms·
I'd argue the fine-tuned UX is often worse. People like RAG-based solutions because you can include references in your answer very easily (eg, Perplexity, or s
by nl 3y ago
I'd argue the fine-tuned UX is often worse.
People like RAG-based solutions because you can include references in your answer very easily (eg, Perplexity, or see the DAnswer "internal search" product launched today on HN). That is extremely hard to make work reliably from a fine-tuned model.
- esafak 3y agoI mean UX from the perspective of the person doing the search, not the engineer. I don't dispute that fine tuning is harder to implement.
- nl 3y agoI mean from the perspective of the person doing the search too. They often want to see the reference - for example the LLM is constructing an answer about some company policy question it is good to include references to the actual company policy documents by URL. This is easy using RAG, but very hard to do reliably just using a fine tuned LLM. See Perplexity for a great example of this at web scale.
- esafak 3y agoThis is true. If LLMs recalled perfectly their purveyors would get into legal trouble :)