3 ms·
I think a better approach is using retrieval augmented generation with Wikipedia. This data source is designed for that: https://huggingface.co/NeuML/txtai-wik
by dmezzetti 3y ago
I think a better approach is using retrieval augmented generation with Wikipedia.
This data source is designed for that: https://huggingface.co/NeuML/txtai-wikipedia https://huggingface.co/NeuML/txtai-wikipedia.
With this source, you can also select articles that are viewed the most, which is another important factor in validating facts. An article which has no views might not be the best source of information.
- audiala 3y agoPart of the issue is to select the right Wikipedia article. Wikidata offers a way to know for sure that you query the LLM with the right data. Also the wikipedia txtai dataset is for english only.