3 ms·
ACL had a recent tutorial about state of the art for this topic. https://acl2023-retrieval-lm.github.io/ https://acl2023-retrieval-lm.github.io/ My favorite ta
by goldemerald 3y ago
ACL had a recent tutorial about state of the art for this topic. https://acl2023-retrieval-lm.github.io/ https://acl2023-retrieval-lm.github.io/
My favorite takeaway was that purely fine tuning your model on your documents (without extra document context during inference) consistently performs worse than using a context added from a datastore.
- atmb4u 3y agoACL tutorial is a treasure trove. Thank you so much for sharing. Do you have any thoughts on how to handle real-time streaming data refreshes in such a system?
- goldemerald 3y agoHire a grad student for a year to write a research paper on it, haha. I've just gotten into the LLM space for work, so I wouldn't know