3 ms·
RAG is great for pulling some additional knowledge, but if you combine it with fine-tuning (i.e., the LLM 'understands' the domain-specific terminology better)
by ingridpan 3y ago
RAG is great for pulling some additional knowledge, but if you combine it with fine-tuning (i.e., the LLM 'understands' the domain-specific terminology better) it becomes a lot more effective
- monkeydust 3y agoLooking exactly into this, any research on this topic?
- ingridpan 3y agoResearch: https://arxiv.org/abs/2005.11401 https://arxiv.org/abs/2005.11401 An implementation on Hugging Face: https://huggingface.co/docs/transformers/model_doc/rag https://huggingface.co/docs/transformers/model_doc/rag
- monkeydust 3y agoTxs but I meant fine tuning and RAG combined