3 ms·
Is anyone aware of techniques to prune a model from useless knowledge to leave more space for the reasoning capabilities? It really shouldn't matter that it ca
by sgu999 4y ago
Is anyone aware of techniques to prune a model from useless knowledge to leave more space for the reasoning capabilities?
It really shouldn't matter that it can give the exact birthdate of Steve Wozniac, as long as it can properly make a query to fetch it and deal with the result.
- cloudking 4y agoI follow your design, couldn't you also solve hallucinations with a "fact checking" LLM (connected to search) that corrects the output of the core LLM? You would take the output of the core LLM, send it to the fact checker with a prompt like "evaluate this output for any potential false statements, and perform an internet search to validate and correct them"