3 ms·
This gave me a nice idea. It would be nice to build a local LLM + wikipedia tool, that uses the LLM to assemble a general answer and then search wikipedia (via
by rlupi 1y ago
This gave me a nice idea.
It would be nice to build a local LLM + wikipedia tool, that uses the LLM to assemble a general answer and then search wikipedia (via full-text search or rag) for grounding facts. It could help with hallucinations of small models a lot.
- Tempat1 1y agoI feel like there could be way more of that kind of thing - LLMs backed by a database of info or accurate tools. e.g. At the risk of massively oversimplifying a complex issue, LLMs are bad at maths; couldn’t we have them use the calculator?
- rlupi 1y agoLLM tools do exactly that. That's why most online LLMs (openai, gemini) have access to sandboxed python for calculations.